Apr 16 13:21:33 devstack cinder-volume[73699]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 13:21:33 devstack cinder-volume[73699]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 13:21:33 devstack cinder-volume[73699]: we strongly recommend against using it for new projects. Apr 16 13:21:33 devstack cinder-volume[73699]: If you are already using Eventlet, we recommend migrating to a different Apr 16 13:21:33 devstack cinder-volume[73699]: framework. For more detail see Apr 16 13:21:33 devstack cinder-volume[73699]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 13:21:33 devstack cinder-volume[73699]: import eventlet # noqa Apr 16 13:21:35 devstack cinder-volume[73699]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73699) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 13:21:35 devstack cinder-volume[73699]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73699) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 13:21:35 devstack cinder-volume[73699]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73699) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 13:21:35 devstack cinder-volume[73699]: INFO dbcounter [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Registered counter for database cinder Apr 16 13:21:35 devstack cinder-volume[73699]: DEBUG oslo_db.sqlalchemy.engines [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG dbcounter [-] [73699] Writer thread running {{(pid=73699) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 13:21:36 devstack cinder-volume[73699]: INFO cinder.rpc [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 13:21:36 devstack cinder-volume[73699]: INFO cinder.rpc [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_db.sqlalchemy.engines [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 13:21:36 devstack cinder-volume[73699]: INFO cinder.volume.manager [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Determined volume DB was empty at startup. Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG cinder.volume.manager [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73699) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 13:21:36 devstack cinder-volume[73699]: INFO cinder.volume.manager [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 16 13:21:36 devstack cinder-volume[73699]: WARNING stevedore.named [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 13:21:36 devstack cinder-volume[73699]: WARNING castellan.key_manager [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 13:21:36 devstack cinder-volume[73699]: WARNING cinder.keymgr.conf_key_mgr [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG cinder.volume.drivers.lvm [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73699) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_concurrency.processutils [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73699) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_concurrency.processutils [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] CMD "cinder-rtstool verify" returned: 0 in 0.250s {{(pid=73699) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_db.sqlalchemy.engines [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 13:21:36 devstack cinder-volume[73699]: INFO cinder.rpc [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 16 13:21:36 devstack cinder-volume[73699]: INFO cinder.rpc [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 16 13:21:36 devstack cinder-volume[73699]: WARNING stevedore.named [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 13:21:36 devstack cinder-volume[73699]: WARNING castellan.key_manager [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 13:21:36 devstack cinder-volume[73699]: INFO cinder.volume.manager [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_db.sqlalchemy.engines [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 13:21:36 devstack cinder-volume[73699]: INFO oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Starting 1 workers Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Started child 73799 {{(pid=73699) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Full set of CONF: {{(pid=73699) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] ******************************************************************************** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Configuration options gathered from: {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] ================================================================================ {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] allow_availability_zone_fallback = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] allow_compression_on_image_upload = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] allowed_direct_url_schemes = [] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] api_rate_limit = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73799]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] auth_strategy = keystone {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] az_cache_duration = 3600 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_availability_zone = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_host = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_name = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_stats_polling_interval = 60 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backup_api_class = cinder.backup.api.API {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backup_name_template = backup-%s {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backup_use_same_host = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backup_use_temp_snapshot = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] chap_password = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] chap_username = {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cinder_internal_tenant_project_id = b56007aac0f144788b6f5730a897a51d {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cinder_internal_tenant_user_id = 3b493ce9a6184a6c8ca4aeb4dbd9ae28 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cloned_volume_same_az = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cluster = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] compression_format = gzip {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] compute_api_class = cinder.compute.nova.API {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] config_dir = [] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] config_source = [] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] control_exchange = openstack {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] debug = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] default_availability_zone = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] default_group_type = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] default_volume_type = lvmdriver-1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] disk_geometry = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] driver_client_cert = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] driver_client_cert_key = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] driver_data_namespace = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] driver_ssl_cert_path = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] driver_ssl_cert_verify = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] driver_use_ssl = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] enable_force_upload = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] enable_new_services = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] enable_unsupported_driver = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] enabled_backends = ['lvmdriver-1'] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] enforce_multipath_for_image_xfer = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] filter_function = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance_api_insecure = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance_api_servers = ['http://192.168.122.253/image'] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance_api_ssl_compression = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance_ca_certificates_file = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance_catalog_info = image:glance:publicURL {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance_certfile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance_keyfile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance_num_retries = 3 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance_request_timeout = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] goodness_function = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] graceful_shutdown_timeout = 5 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] group_api_class = cinder.group.api.API {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] host = devstack {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] image_compress_on_upload = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] image_conversion_address_space_limit = 1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] image_conversion_cpu_limit = 60 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] image_conversion_disable = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] image_upload_use_cinder_backend = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] image_upload_use_internal_tenant = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] image_volume_cache_enabled = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] image_volume_cache_max_count = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] image_volume_cache_max_size_gb = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] init_host_max_objects_retrieval = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] instance_format = [instance: %(uuid)s] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] iscsi_target_flags = {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] iscsi_write_cache = on {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] iser_helper = tgtadm {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] iser_ip_address = 192.168.122.253 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] iser_port = 3260 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] log_color = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] log_config_append = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] log_dir = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] log_file = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] log_options = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] log_rotate_interval = 1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] log_rotate_interval_type = days {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] log_rotation_type = none {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73799]: INFO cinder.volume.manager [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] max_age = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] max_logfile_count = 30 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] max_logfile_size_mb = 200 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] max_over_subscription_ratio = 20.0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] message_reap_interval = 86400 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] message_ttl = 2592000 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] migration_create_volume_timeout_secs = 300 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] monkey_patch = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] monkey_patch_modules = [] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] my_ip = 192.168.122.253 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] no_snapshot_gb_quota = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] num_iser_scan_tries = 3 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] num_shell_tries = 3 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] num_volume_device_scan_tries = 3 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] nvmeof_conn_info_version = 1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] nvmet_ns_id = 10 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] nvmet_port_id = 1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] osapi_max_limit = 1000 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] osapi_volume_ext_list = [] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] osapi_volume_listen = 0.0.0.0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] osapi_volume_listen_port = 8776 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] osapi_volume_use_ssl = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] osapi_volume_workers = 2 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] per_volume_size_limit = -1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] periodic_fuzzy_delay = 60 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] periodic_interval = 60 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] project_id_regex = [0-9a-f\-]+ {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] public_endpoint = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] publish_errors = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] quota_backup_gigabytes = 1000 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] quota_backups = 10 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] quota_gigabytes = 1000 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] quota_groups = 10 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] quota_snapshots = 10 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] quota_volumes = 10 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] rate_limit_burst = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] rate_limit_except_level = CRITICAL {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] rate_limit_interval = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] reinit_driver_count = 3 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] replication_device = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] report_discard_supported = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] report_interval = 120 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] reservation_clean_interval = 86400 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] reservation_expire = 86400 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] reserved_image_namespaces = [] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] reserved_percentage = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] rpc_response_timeout = 120 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] run_external_periodic_tasks = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] scst_target_driver = iscsi {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] scst_target_iqn_name = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] service_down_time = 720 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] shell_completion = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] snapshot_name_template = snapshot-%s {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] snapshot_same_host = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] split_loggers = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] state_path = /opt/stack/data/cinder {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] storage_availability_zone = nova {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] storage_protocol = iSCSI {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] syslog_log_facility = LOG_USER {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] target_helper = lioadm {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] target_ip_address = 192.168.122.253 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] target_port = 3260 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] target_protocol = iscsi {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] target_secondary_ip_addresses = [] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] trace_flags = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] transfer_api_class = cinder.transfer.api.API {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] transport_url = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] until_refresh = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] use_chap_auth = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] use_default_quota_class = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] use_journal = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] use_json = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] use_multipath_for_image_xfer = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] use_stderr = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] use_syslog = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] verify_glance_signatures = enabled {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] volume_api_class = cinder.volume.api.API {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] volume_backend_name = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] volume_clear = zero {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] volume_clear_ionice = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] volume_clear_size = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] volume_copy_bps_limit = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] volume_dd_blocksize = 1M {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] volume_name_template = volume-%s {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] volume_service_inithost_offload = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] volume_usage_audit_period = month {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] zoning_mode = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_concurrency.disable_process_locking = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.admin_password = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.admin_token = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.admin_user = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.auth_admin_prefix = {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.auth_port = 35357 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.auth_protocol = https {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.auth_section = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.auth_type = password {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.auth_uri = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.auth_version = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.cache = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.certfile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.identity_uri = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.include_service_catalog = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.insecure = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.interface = public {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.keyfile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.memcache_password = {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.memcache_username = {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.region_name = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.service_type = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.253/identity {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.backend = dogpile.cache.null {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.backend_argument = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.backend_expiration_time = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.config_prefix = cache.oslo {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.debug_cache_backend = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.enable_retry_client = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.enable_socket_keepalive = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.enabled = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.enforce_fips_mode = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.expiration_time = 600 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.hashclient_retry_attempts = 2 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.memcache_dead_retry = 300 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.memcache_pool_maxsize = 10 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.memcache_sasl_enabled = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.password = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.proxies = [] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.redis_db = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.redis_server = localhost:6379 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.retry_attempts = 2 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.retry_delay = 0.0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.socket_keepalive_count = 1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.socket_keepalive_idle = 1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.socket_keepalive_interval = 1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.socket_timeout = 1.0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.tls_allowed_ciphers = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.tls_cafile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.tls_certfile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.tls_enabled = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.tls_keyfile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cache.username = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] coordination.backend_url = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.asyncio_connection = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.asyncio_slave_connection = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.backend = sqlalchemy {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.connection = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.connection_debug = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.connection_parameters = {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.connection_recycle_time = 3600 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.connection_trace = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.db_inc_retry_interval = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.db_max_retries = 20 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.db_max_retry_interval = 10 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.db_retry_interval = 1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.max_overflow = 50 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.max_pool_size = 5 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.max_retries = 10 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.mysql_wsrep_sync_wait = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.pool_timeout = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.retry_interval = 10 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.slave_connection = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.sqlite_synchronous = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.synchronous_reader = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] database.use_db_reconnect = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] profiler.connection_string = messaging:// {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] profiler.enabled = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] profiler.es_doc_type = notification {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] profiler.es_scroll_size = 10000 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] profiler.es_scroll_time = 2m {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] profiler.filter_error_trace = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] profiler.hmac_keys = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] profiler.sentinel_service_name = mymaster {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] profiler.socket_timeout = 0.1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] profiler.trace_requests = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] profiler.trace_sqlalchemy = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] profiler_jaeger.process_tags = {} {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] profiler_jaeger.service_name_prefix = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] profiler_otlp.service_name_prefix = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_policy.enforce_new_defaults = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: WARNING oslo_config.cfg [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_policy.enforce_scope = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_policy.policy_default_rule = default {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_policy.policy_file = policy.yaml {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_policy.remote_timeout = 60.0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] privsep_osbrick.group = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] privsep_osbrick.helper_command = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] privsep_osbrick.user = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cinder_sys_admin.group = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cinder_sys_admin.helper_command = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] cinder_sys_admin.user = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] service_user.auth_section = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] service_user.auth_type = password {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] service_user.cafile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] service_user.certfile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] service_user.collect_timing = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] service_user.insecure = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] service_user.keyfile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] service_user.send_service_user_token = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] service_user.split_loggers = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] service_user.timeout = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance.auth_section = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance.auth_type = password {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance.certfile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance.collect_timing = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance.insecure = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance.keyfile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance.region_name = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance.split_loggers = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] glance.timeout = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.backend_availability_zone = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.chap_password = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.chap_username = {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.disk_geometry = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.driver_client_cert = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.driver_client_cert_key = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.driver_data_namespace = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.driver_use_ssl = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.extra_capabilities = {} {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.filter_function = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.goodness_function = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.iscsi_target_flags = {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.iscsi_write_cache = on {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.iser_helper = tgtadm {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.iser_ip_address = 192.168.122.253 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.iser_port = 3260 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.lvm_mirrors = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.lvm_share_target = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.lvm_type = auto {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.num_shell_tries = 3 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.replication_device = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.report_discard_supported = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.reserved_percentage = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.target_helper = tgtadm {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.target_ip_address = 192.168.122.253 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.target_port = 3260 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.target_protocol = iscsi {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.trace_flags = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.unique_fqdn_network = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.use_chap_auth = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.volume_backend_name = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.volume_clear = zero {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.volume_clear_ionice = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.volume_clear_size = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.volume_group = cinder-volumes {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_reports.file_event_handler = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_reports.log_dir = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.backend_host = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.chap_password = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.chap_username = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.chiscsi_conf = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.disk_geometry = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack sudo[73809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.driver_client_cert = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack sudo[73809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.driver_use_ssl = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.extra_capabilities = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.filter_function = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.goodness_function = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.iser_helper = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.iser_ip_address = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.iser_port = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.lvm_conf_file = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.lvm_mirrors = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.lvm_share_target = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.lvm_type = auto {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.num_shell_tries = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.nvmet_port_id = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.replication_device = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.report_discard_supported = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.reserved_percentage = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.scst_target_driver = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.storage_protocol = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.target_helper = lioadm {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.target_ip_address = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.target_port = 3260 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.target_protocol = iscsi {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.trace_flags = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.use_chap_auth = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.volume_clear = zero {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.volume_clear_size = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] lvmdriver-1.volumes_dir = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.ssl = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.ssl_version = {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_notifications.driver = [] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_notifications.retry = -1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] key_manager.fixed_key = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican.barbican_api_version = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican.barbican_endpoint = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican.barbican_endpoint_type = public {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican.barbican_region_name = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican.cafile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican.certfile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican.collect_timing = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican.insecure = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican.keyfile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican.number_of_retries = 60 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican.retry_delay = 1 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican.send_service_user_token = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican.split_loggers = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican.timeout = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican.verify_ssl = True {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican.verify_ssl_path = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican_service_user.auth_section = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican_service_user.auth_type = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican_service_user.cafile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican_service_user.certfile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican_service_user.collect_timing = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican_service_user.insecure = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican_service_user.keyfile = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican_service_user.split_loggers = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] barbican_service_user.timeout = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] vault.approle_role_id = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] vault.approle_secret_id = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] vault.kv_mountpoint = secret {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] vault.kv_path = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] vault.kv_version = 2 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] vault.namespace = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] vault.root_token_id = **** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] vault.ssl_ca_crt_file = None {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] vault.timeout = 60.0 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] vault.use_ssl = False {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:21:36 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] ******************************************************************************** {{(pid=73699) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 13:21:37 devstack sudo[73809]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:37 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.517s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:37 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:37 devstack sudo[73812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 13:21:37 devstack sudo[73812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:37 devstack sudo[73812]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:37 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.521s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:37 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 13:21:37 devstack cinder-volume[73799]: INFO cinder.brick.local_dev.lvm [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 16 13:21:37 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:37 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:37 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:37 devstack sudo[74004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 13:21:37 devstack sudo[74004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:38 devstack sudo[74004]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:38 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.521s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:38 devstack cinder-volume[73799]: DEBUG cinder.brick.local_dev.lvm [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73799) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 16 13:21:38 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:38 devstack sudo[74187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 13:21:38 devstack sudo[74187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:39 devstack sudo[74187]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:39 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.975s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:39 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:39 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:39 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:39 devstack sudo[74401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 13:21:39 devstack sudo[74401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:39 devstack sudo[74401]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:39 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.501s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:39 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:39 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:39 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:39 devstack sudo[74490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 16 13:21:39 devstack sudo[74490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:40 devstack sudo[74490]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:40 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.466s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:40 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:40 devstack sudo[74493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 13:21:40 devstack sudo[74493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:40 devstack sudo[74493]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:40 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:40 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:40 devstack sudo[74500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 13:21:40 devstack sudo[74500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:41 devstack sudo[74500]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:41 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:41 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:41 devstack sudo[74505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 13:21:41 devstack sudo[74505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:41 devstack sudo[74505]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:41 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:41 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:41 devstack sudo[74508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 13:21:41 devstack sudo[74508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:41 devstack sudo[74508]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:41 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.446s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:41 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:41 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:41 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:41 devstack sudo[74514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 13:21:41 devstack sudo[74514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:42 devstack sudo[74514]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:42 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.463s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:42 devstack cinder-volume[73799]: INFO cinder.volume.drivers.lvm [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 16 13:21:42 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:42 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:42 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:42 devstack sudo[74521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 13:21:42 devstack sudo[74521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:42 devstack sudo[74521]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:42 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.488s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:42 devstack cinder-volume[73799]: DEBUG cinder.volume.drivers.lvm [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Updating volume stats {{(pid=73799) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 13:21:42 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:42 devstack sudo[74553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 13:21:42 devstack sudo[74553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:43 devstack sudo[74553]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:43 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:43 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:43 devstack sudo[74644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 13:21:43 devstack sudo[74644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:43 devstack sudo[74644]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:43 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:43 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:43 devstack sudo[74656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 13:21:43 devstack sudo[74656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:44 devstack sudo[74656]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:44 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.476s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:44 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:44 devstack sudo[74789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 13:21:44 devstack sudo[74789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:44 devstack sudo[74789]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:44 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:44 devstack cinder-volume[73799]: INFO cinder.volume.driver [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Driver hasn't implemented _init_vendor_properties() Apr 16 13:21:44 devstack cinder-volume[73799]: DEBUG cinder.volume.driver [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73799) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 13:21:44 devstack cinder-volume[73799]: DEBUG oslo_db.sqlalchemy.engines [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73799) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 13:21:44 devstack cinder-volume[73799]: DEBUG dbcounter [-] [73799] Writer thread running {{(pid=73799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 13:21:44 devstack cinder-volume[73799]: DEBUG cinder.db.sqlalchemy.api [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Building query based on filter {{(pid=73799) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 13:21:44 devstack cinder-volume[73799]: DEBUG cinder.image.image_utils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73799) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 13:21:44 devstack cinder-volume[73799]: INFO cinder.keymgr.migration [None req-91a12b36-f68f-4e1a-9e2c-07147eae364f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 13:21:44 devstack cinder-volume[73799]: DEBUG cinder.volume.drivers.lvm [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Updating volume stats {{(pid=73799) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 13:21:44 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:44 devstack sudo[74794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 13:21:44 devstack sudo[74794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:45 devstack sudo[74794]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:45 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:45 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:45 devstack sudo[74797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 13:21:45 devstack sudo[74797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:45 devstack sudo[74797]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:45 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:45 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:45 devstack sudo[74800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 13:21:45 devstack sudo[74800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:46 devstack sudo[74800]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:46 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.476s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:46 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:46 devstack sudo[74804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 13:21:46 devstack sudo[74804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:46 devstack cinder-volume[73699]: DEBUG dbcounter [-] [73699] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73699) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:21:46 devstack sudo[74804]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:46 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:46 devstack cinder-volume[73799]: DEBUG cinder.manager [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Notifying Schedulers of capabilities ... {{(pid=73799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:21:46 devstack cinder-volume[73799]: INFO cinder.volume.manager [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Driver initialization completed successfully. Apr 16 13:21:46 devstack cinder-volume[73799]: INFO cinder.manager [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Initiating service 2 cleanup Apr 16 13:21:46 devstack cinder-volume[73799]: INFO cinder.manager [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Service 2 cleanup completed. Apr 16 13:21:46 devstack cinder-volume[73799]: DEBUG cinder.service [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Creating RPC server for service cinder-volume {{(pid=73799) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 13:21:46 devstack cinder-volume[73799]: DEBUG cinder.service [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73799) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 13:21:46 devstack cinder-volume[73799]: INFO cinder.volume.manager [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 16 13:21:46 devstack cinder-volume[73799]: DEBUG cinder.volume.drivers.lvm [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Updating volume stats {{(pid=73799) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 13:21:46 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:46 devstack sudo[74812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 13:21:46 devstack sudo[74812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:47 devstack sudo[74812]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:47 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:47 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:47 devstack sudo[74817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 13:21:47 devstack sudo[74817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:47 devstack sudo[74817]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:47 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:47 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:47 devstack sudo[74820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 13:21:47 devstack sudo[74820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:48 devstack sudo[74820]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:48 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.478s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:48 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:21:48 devstack sudo[74837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 13:21:48 devstack sudo[74837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:21:48 devstack sudo[74837]: pam_unix(sudo:session): session closed for user root Apr 16 13:21:48 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:21:48 devstack cinder-volume[73799]: INFO cinder.volume.manager [None req-6c2d374d-8d52-414f-b799-dd11daabfe04 None None] Driver post RPC initialization completed successfully. Apr 16 13:21:56 devstack cinder-volume[73799]: DEBUG dbcounter [-] [73799] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:21:58 devstack cinder-volume[73799]: DEBUG dbcounter [-] [73799] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:23:06 devstack cinder-volume[73799]: DEBUG oslo_service.periodic_task [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 13:23:06 devstack cinder-volume[73799]: DEBUG cinder.volume.drivers.lvm [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Updating volume stats {{(pid=73799) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 13:23:06 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:23:06 devstack sudo[79762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 13:23:06 devstack sudo[79762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:23:07 devstack sudo[79762]: pam_unix(sudo:session): session closed for user root Apr 16 13:23:07 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:23:07 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:23:07 devstack sudo[79767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 13:23:07 devstack sudo[79767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:23:07 devstack sudo[79767]: pam_unix(sudo:session): session closed for user root Apr 16 13:23:07 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:23:07 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:23:07 devstack sudo[79773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 13:23:07 devstack sudo[79773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:23:07 devstack sudo[79773]: pam_unix(sudo:session): session closed for user root Apr 16 13:23:07 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.436s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:23:07 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:23:08 devstack sudo[79776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 13:23:08 devstack sudo[79776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:23:08 devstack sudo[79776]: pam_unix(sudo:session): session closed for user root Apr 16 13:23:08 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:23:08 devstack cinder-volume[73799]: DEBUG cinder.manager [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Notifying Schedulers of capabilities ... {{(pid=73799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:23:58 devstack cinder-volume[73799]: DEBUG dbcounter [-] [73799] Writing DB stats cinder:SELECT=1 {{(pid=73799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:23:58 devstack cinder-volume[73799]: DEBUG dbcounter [-] [73799] Writing DB stats cinder:UPDATE=1 {{(pid=73799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:24:06 devstack cinder-volume[73799]: DEBUG oslo_service.periodic_task [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 13:24:06 devstack cinder-volume[73799]: DEBUG cinder.volume.drivers.lvm [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Updating volume stats {{(pid=73799) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 13:24:06 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:24:06 devstack sudo[81640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 13:24:06 devstack sudo[81640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:24:07 devstack sudo[81640]: pam_unix(sudo:session): session closed for user root Apr 16 13:24:07 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:24:07 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:24:07 devstack sudo[81644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 13:24:07 devstack sudo[81644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:24:07 devstack sudo[81644]: pam_unix(sudo:session): session closed for user root Apr 16 13:24:07 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:24:07 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:24:07 devstack sudo[81670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 13:24:07 devstack sudo[81670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:24:08 devstack sudo[81670]: pam_unix(sudo:session): session closed for user root Apr 16 13:24:08 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.452s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:24:08 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:24:08 devstack sudo[81676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 13:24:08 devstack sudo[81676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:24:08 devstack sudo[81676]: pam_unix(sudo:session): session closed for user root Apr 16 13:24:08 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:24:08 devstack cinder-volume[73799]: DEBUG cinder.manager [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Notifying Schedulers of capabilities ... {{(pid=73799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:25:03 devstack cinder-volume[73699]: INFO oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Caught SIGTERM, stopping children Apr 16 13:25:03 devstack cinder-volume[73699]: DEBUG oslo_concurrency.lockutils [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Acquiring lock "singleton_lock" {{(pid=73699) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 13:25:03 devstack cinder-volume[73699]: DEBUG oslo_concurrency.lockutils [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Acquired lock "singleton_lock" {{(pid=73699) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 13:25:03 devstack cinder-volume[73699]: DEBUG oslo_concurrency.lockutils [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Releasing lock "singleton_lock" {{(pid=73699) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 13:25:03 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Stop services. {{(pid=73699) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 16 13:25:03 devstack cinder-volume[73699]: DEBUG oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Killing children. {{(pid=73699) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 16 13:25:03 devstack cinder-volume[73699]: INFO oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Waiting on 1 children to exit Apr 16 13:25:06 devstack cinder-volume[73799]: DEBUG oslo_service.periodic_task [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 13:25:06 devstack cinder-volume[73799]: DEBUG cinder.volume.drivers.lvm [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Updating volume stats {{(pid=73799) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 13:25:06 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:25:06 devstack sudo[82998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 13:25:06 devstack sudo[82998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:25:07 devstack sudo[82998]: pam_unix(sudo:session): session closed for user root Apr 16 13:25:07 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:25:07 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:25:07 devstack sudo[83001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 13:25:07 devstack sudo[83001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:25:07 devstack sudo[83001]: pam_unix(sudo:session): session closed for user root Apr 16 13:25:07 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:25:07 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:25:07 devstack sudo[83004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 13:25:07 devstack sudo[83004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:25:07 devstack sudo[83004]: pam_unix(sudo:session): session closed for user root Apr 16 13:25:07 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:25:08 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:25:08 devstack sudo[83007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 13:25:08 devstack sudo[83007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:25:08 devstack sudo[83007]: pam_unix(sudo:session): session closed for user root Apr 16 13:25:08 devstack cinder-volume[73799]: DEBUG oslo_concurrency.processutils [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=73799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:25:08 devstack cinder-volume[73799]: DEBUG cinder.manager [None req-a3557809-a6e5-45ce-9868-4008471806f0 None None] Notifying Schedulers of capabilities ... {{(pid=73799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:25:08 devstack cinder-volume[73799]: DEBUG oslo_concurrency.lockutils [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Acquiring lock "singleton_lock" {{(pid=73799) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 13:25:08 devstack cinder-volume[73799]: DEBUG oslo_concurrency.lockutils [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Acquired lock "singleton_lock" {{(pid=73799) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 13:25:08 devstack cinder-volume[73799]: DEBUG oslo_concurrency.lockutils [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Releasing lock "singleton_lock" {{(pid=73799) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 13:25:08 devstack cinder-volume[73799]: WARNING amqp [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 13:25:08 devstack cinder-volume[73799]: WARNING amqp [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 13:25:08 devstack cinder-volume[73699]: INFO oslo_service.backend._eventlet.service [None req-c14a9ca4-32d0-4fce-92e0-110e2b273f27 None None] Child 73799 exited with status 0 Apr 16 13:25:08 devstack cinder-volume[83010]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 13:25:08 devstack cinder-volume[83010]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 13:25:08 devstack cinder-volume[83010]: we strongly recommend against using it for new projects. Apr 16 13:25:08 devstack cinder-volume[83010]: If you are already using Eventlet, we recommend migrating to a different Apr 16 13:25:08 devstack cinder-volume[83010]: framework. For more detail see Apr 16 13:25:08 devstack cinder-volume[83010]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 13:25:08 devstack cinder-volume[83010]: import eventlet # noqa Apr 16 13:25:10 devstack cinder-volume[83010]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 13:25:10 devstack cinder-volume[83010]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 13:25:10 devstack cinder-volume[83010]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 13:25:11 devstack cinder-volume[83010]: INFO dbcounter [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Registered counter for database cinder Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_db.sqlalchemy.engines [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83010) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG dbcounter [-] [83010] Writer thread running {{(pid=83010) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 13:25:11 devstack cinder-volume[83010]: INFO cinder.rpc [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 13:25:11 devstack cinder-volume[83010]: INFO cinder.rpc [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_db.sqlalchemy.engines [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83010) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 13:25:11 devstack cinder-volume[83010]: INFO cinder.volume.manager [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Determined volume DB was empty at startup. Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG cinder.volume.manager [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83010) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 13:25:11 devstack cinder-volume[83010]: INFO cinder.volume.manager [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 16 13:25:11 devstack cinder-volume[83010]: WARNING stevedore.named [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 13:25:11 devstack cinder-volume[83010]: WARNING castellan.key_manager [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 13:25:11 devstack cinder-volume[83010]: WARNING cinder.keymgr.conf_key_mgr [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 13:25:11 devstack cinder-volume[83010]: INFO cinder.volume.manager [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_db.sqlalchemy.engines [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83010) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 13:25:11 devstack cinder-volume[83010]: INFO oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Starting 1 workers Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Started child 83210 {{(pid=83010) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Full set of CONF: {{(pid=83010) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] ******************************************************************************** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Configuration options gathered from: {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] ================================================================================ {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] allow_availability_zone_fallback = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] allow_compression_on_image_upload = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] allowed_direct_url_schemes = [] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] api_rate_limit = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] auth_strategy = keystone {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_availability_zone = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_host = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_name = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_stats_polling_interval = 60 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backup_api_class = cinder.backup.api.API {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backup_name_template = backup-%s {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backup_use_same_host = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backup_use_temp_snapshot = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] chap_password = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] chap_username = {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cinder_internal_tenant_project_id = b56007aac0f144788b6f5730a897a51d {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cinder_internal_tenant_user_id = 3b493ce9a6184a6c8ca4aeb4dbd9ae28 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cluster = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] compression_format = gzip {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] compute_api_class = cinder.compute.nova.API {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] config_dir = [] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] config_source = [] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] control_exchange = openstack {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] debug = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] default_availability_zone = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] default_group_type = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] default_volume_type = QuobyteHD {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] disk_geometry = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] driver_client_cert = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] driver_client_cert_key = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] driver_data_namespace = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] driver_ssl_cert_path = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] driver_ssl_cert_verify = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] driver_use_ssl = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] enable_new_services = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] enable_unsupported_driver = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] enabled_backends = ['QuobyteHD'] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] enforce_multipath_for_image_xfer = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] filter_function = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance_api_insecure = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance_api_servers = ['http://192.168.122.253/image'] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance_api_ssl_compression = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance_ca_certificates_file = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance_catalog_info = image:glance:publicURL {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance_certfile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance_keyfile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83210]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance_num_retries = 3 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance_request_timeout = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] goodness_function = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] graceful_shutdown_timeout = 5 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] group_api_class = cinder.group.api.API {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] host = devstack {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] image_compress_on_upload = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] image_conversion_address_space_limit = 1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] image_conversion_cpu_limit = 60 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] image_conversion_disable = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] image_upload_use_cinder_backend = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] image_upload_use_internal_tenant = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] image_volume_cache_enabled = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] image_volume_cache_max_count = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] image_volume_cache_max_size_gb = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] init_host_max_objects_retrieval = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] instance_format = [instance: %(uuid)s] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] iscsi_target_flags = {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] iscsi_write_cache = on {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] iser_helper = tgtadm {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] iser_ip_address = 192.168.122.253 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] iser_port = 3260 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] log_color = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] log_config_append = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] log_dir = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] log_file = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] log_options = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] log_rotate_interval = 1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] log_rotate_interval_type = days {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] log_rotation_type = none {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] max_age = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] max_logfile_count = 30 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] max_logfile_size_mb = 200 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] max_over_subscription_ratio = 20.0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] message_reap_interval = 86400 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] message_ttl = 2592000 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] migration_create_volume_timeout_secs = 300 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] monkey_patch = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] monkey_patch_modules = [] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] my_ip = 192.168.122.253 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] no_snapshot_gb_quota = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] num_iser_scan_tries = 3 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] num_shell_tries = 3 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] num_volume_device_scan_tries = 3 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] nvmeof_conn_info_version = 1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] nvmet_ns_id = 10 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] nvmet_port_id = 1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] osapi_max_limit = 1000 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] osapi_volume_ext_list = [] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] osapi_volume_listen = 0.0.0.0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] osapi_volume_listen_port = 8776 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] osapi_volume_use_ssl = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] osapi_volume_workers = 2 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] per_volume_size_limit = -1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] periodic_fuzzy_delay = 60 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] periodic_interval = 60 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] project_id_regex = [0-9a-f\-]+ {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] public_endpoint = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] publish_errors = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] quota_backup_gigabytes = 1000 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] quota_backups = 10 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] quota_gigabytes = 1000 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] quota_groups = 10 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] quota_snapshots = 10 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] quota_volumes = 10 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] rate_limit_burst = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] rate_limit_except_level = CRITICAL {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] rate_limit_interval = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] reinit_driver_count = 3 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] replication_device = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] report_discard_supported = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] report_interval = 120 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] reservation_clean_interval = 86400 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] reservation_expire = 86400 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] reserved_image_namespaces = [] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] reserved_percentage = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] rpc_response_timeout = 120 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] run_external_periodic_tasks = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] scst_target_driver = iscsi {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] scst_target_iqn_name = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83210]: INFO cinder.volume.manager [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 16 13:25:11 devstack cinder-volume[83210]: DEBUG cinder.volume.drivers.remotefs [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83210) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] service_down_time = 720 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] shell_completion = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] snapshot_name_template = snapshot-%s {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] split_loggers = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] state_path = /opt/stack/data/cinder {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] storage_availability_zone = nova {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] storage_protocol = iSCSI {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] syslog_log_facility = LOG_USER {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] target_helper = lioadm {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] target_ip_address = 192.168.122.253 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] target_port = 3260 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] target_protocol = iscsi {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] target_secondary_ip_addresses = [] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] trace_flags = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] transfer_api_class = cinder.transfer.api.API {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] transport_url = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] until_refresh = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] use_chap_auth = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] use_default_quota_class = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] use_journal = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] use_json = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] use_multipath_for_image_xfer = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] use_stderr = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] use_syslog = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] verify_glance_signatures = enabled {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] volume_api_class = cinder.volume.api.API {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] volume_backend_name = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] volume_clear = zero {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] volume_clear_ionice = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] volume_clear_size = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] volume_copy_bps_limit = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] volume_dd_blocksize = 1M {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] volume_name_template = volume-%s {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] volume_service_inithost_offload = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] volume_usage_audit_period = month {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] zoning_mode = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_concurrency.disable_process_locking = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.admin_password = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.admin_token = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.admin_user = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.auth_admin_prefix = {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.auth_port = 35357 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.auth_protocol = https {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.auth_section = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.auth_type = password {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.auth_uri = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.auth_version = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.cache = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.certfile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.delay_auth_decision = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.http_connect_timeout = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.identity_uri = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.include_service_catalog = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.insecure = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.interface = public {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.keyfile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.memcache_password = {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.memcache_username = {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.region_name = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.service_token_roles_required = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.service_type = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.token_cache_time = 300 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.253/identity {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.backend = dogpile.cache.null {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.backend_argument = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.backend_expiration_time = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.config_prefix = cache.oslo {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.debug_cache_backend = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.enable_retry_client = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.enable_socket_keepalive = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.enabled = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.enforce_fips_mode = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.expiration_time = 600 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.hashclient_retry_attempts = 2 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.memcache_dead_retry = 300 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.memcache_pool_maxsize = 10 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.memcache_sasl_enabled = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.password = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.proxies = [] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.redis_db = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.redis_sentinel_service_name = mymaster {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.redis_server = localhost:6379 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.retry_attempts = 2 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.retry_delay = 0.0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.socket_keepalive_count = 1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.socket_keepalive_idle = 1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.socket_keepalive_interval = 1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.socket_timeout = 1.0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.tls_allowed_ciphers = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.tls_cafile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.tls_certfile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.tls_enabled = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.tls_keyfile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cache.username = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] coordination.backend_url = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.asyncio_connection = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.asyncio_slave_connection = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.backend = sqlalchemy {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.connection = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.connection_debug = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.connection_parameters = {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.connection_recycle_time = 3600 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.connection_trace = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.db_inc_retry_interval = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.db_max_retries = 20 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.db_max_retry_interval = 10 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.db_retry_interval = 1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.max_overflow = 50 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.max_pool_size = 5 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.max_retries = 10 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.mysql_wsrep_sync_wait = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.pool_timeout = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.retry_interval = 10 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.slave_connection = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.sqlite_synchronous = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.synchronous_reader = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] database.use_db_reconnect = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] profiler.connection_string = messaging:// {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] profiler.enabled = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] profiler.es_doc_type = notification {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] profiler.es_scroll_size = 10000 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] profiler.es_scroll_time = 2m {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] profiler.filter_error_trace = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] profiler.hmac_keys = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] profiler.sentinel_service_name = mymaster {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] profiler.socket_timeout = 0.1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] profiler.trace_requests = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] profiler.trace_sqlalchemy = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] profiler_jaeger.process_tags = {} {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] profiler_jaeger.service_name_prefix = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] profiler_otlp.service_name_prefix = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_policy.enforce_new_defaults = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: WARNING oslo_config.cfg [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_policy.enforce_scope = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_policy.policy_default_rule = default {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83210]: DEBUG cinder.volume.drivers.quobyte [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83210) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 16 13:25:11 devstack cinder-volume[83210]: WARNING cinder.volume.drivers.quobyte [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 16 13:25:11 devstack cinder-volume[83210]: WARNING cinder.volume.drivers.quobyte [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 16 13:25:11 devstack cinder-volume[83210]: DEBUG oslo_concurrency.processutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Running cmd (subprocess): mount.quobyte {{(pid=83210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_policy.policy_file = policy.yaml {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_policy.remote_timeout = 60.0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] privsep_osbrick.group = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] privsep_osbrick.helper_command = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] privsep_osbrick.user = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cinder_sys_admin.group = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cinder_sys_admin.helper_command = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] cinder_sys_admin.user = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] service_user.auth_section = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] service_user.auth_type = password {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] service_user.cafile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] service_user.certfile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] service_user.collect_timing = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] service_user.insecure = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] service_user.keyfile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] service_user.send_service_user_token = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] service_user.split_loggers = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] service_user.timeout = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance.auth_section = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance.auth_type = password {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance.certfile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance.collect_timing = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance.insecure = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance.keyfile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance.region_name = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance.split_loggers = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] glance.timeout = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.backend_availability_zone = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.chap_password = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.chap_username = {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.disk_geometry = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.driver_client_cert = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.driver_client_cert_key = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.driver_data_namespace = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.driver_use_ssl = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.enable_unsupported_driver = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.extra_capabilities = {} {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.filter_function = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.goodness_function = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.iscsi_target_flags = {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.iscsi_write_cache = on {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.iser_helper = tgtadm {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.iser_ip_address = 192.168.122.253 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.iser_port = 3260 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.nas_host = {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.nas_login = admin {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.nas_mount_options = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.nas_password = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.nas_private_key = {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.nas_share_path = {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.nas_ssh_port = 22 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.num_shell_tries = 3 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.nvmet_port_id = 1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.quobyte_client_cfg = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.quobyte_volume_url = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.replication_device = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.report_discard_supported = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.reserved_percentage = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.scst_target_driver = iscsi {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.scst_target_iqn_name = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.storage_protocol = iSCSI {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.target_helper = tgtadm {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.target_ip_address = 192.168.122.253 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.target_port = 3260 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.target_protocol = iscsi {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.trace_flags = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.unique_fqdn_network = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.use_chap_auth = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.volume_backend_name = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.volume_clear = zero {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.volume_clear_ionice = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.volume_clear_size = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_reports.file_event_handler = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_reports.log_dir = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.backend_availability_zone = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.backend_host = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.chap_password = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.chap_username = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.chiscsi_conf = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.disk_geometry = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.driver_client_cert = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.driver_client_cert_key = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.driver_data_namespace = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.driver_use_ssl = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.extra_capabilities = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.filter_function = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.goodness_function = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.iscsi_target_flags = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.iscsi_write_cache = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.iser_helper = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.iser_ip_address = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.iser_port = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.iser_target_prefix = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.nas_host = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.nas_login = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.nas_mount_options = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.nas_password = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.nas_private_key = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.nas_share_path = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.nas_ssh_port = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.num_shell_tries = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.nvmet_ns_id = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.nvmet_port_id = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.replication_device = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.report_discard_supported = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.reserved_percentage = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.scst_target_driver = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.storage_protocol = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.target_helper = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.target_ip_address = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.target_port = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.target_prefix = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.target_protocol = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.trace_flags = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.unique_fqdn_network = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.use_chap_auth = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.volume_clear = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.volume_clear_ionice = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.volume_clear_size = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] QuobyteHD.volumes_dir = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.ssl = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.ssl_version = {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_notifications.driver = [] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_notifications.retry = -1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] oslo_messaging_notifications.transport_url = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] key_manager.fixed_key = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican.barbican_api_version = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican.barbican_endpoint = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican.barbican_endpoint_type = public {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican.barbican_region_name = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican.cafile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican.certfile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican.collect_timing = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican.insecure = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican.keyfile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican.number_of_retries = 60 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican.retry_delay = 1 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican.send_service_user_token = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican.split_loggers = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican.timeout = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican.verify_ssl = True {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican.verify_ssl_path = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican_service_user.auth_section = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack quobyte-client[83214]: Reading configuration file: /etc/quobyte/client.cfg Apr 16 13:25:11 devstack quobyte-client[83214]: Invalid parameters found, error: missing mount point. Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican_service_user.auth_type = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican_service_user.cafile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack quobyte-client[83214]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 16 13:25:11 devstack quobyte-client[83214]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican_service_user.certfile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican_service_user.collect_timing = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican_service_user.insecure = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican_service_user.keyfile = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican_service_user.split_loggers = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] barbican_service_user.timeout = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] vault.approle_role_id = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] vault.approle_secret_id = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83210]: DEBUG oslo_concurrency.processutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=83210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:25:11 devstack cinder-volume[83210]: DEBUG oslo_concurrency.lockutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:25:11 devstack cinder-volume[83210]: DEBUG oslo_concurrency.lockutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:25:11 devstack cinder-volume[83210]: DEBUG cinder.volume.drivers.quobyte [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83210) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] vault.kv_mountpoint = secret {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] vault.kv_path = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83210]: INFO cinder.volume.drivers.quobyte [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 ... Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] vault.kv_version = 2 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] vault.namespace = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83210]: DEBUG oslo_concurrency.processutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e -c /etc/quobyte/client-cinder.cfg {{(pid=83210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] vault.root_token_id = **** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] vault.ssl_ca_crt_file = None {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] vault.timeout = 60.0 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] vault.use_ssl = False {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:11 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] ******************************************************************************** {{(pid=83010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 13:25:11 devstack sudo[83215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e -c /etc/quobyte/client-cinder.cfg Apr 16 13:25:11 devstack sudo[83215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:25:12 devstack sudo[83215]: pam_unix(sudo:session): session closed for user root Apr 16 13:25:12 devstack cinder-volume[83210]: DEBUG oslo_concurrency.processutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.502s {{(pid=83210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:25:12 devstack cinder-volume[83210]: INFO cinder.volume.drivers.quobyte [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 succeeded Apr 16 13:25:12 devstack cinder-volume[83210]: DEBUG cinder.volume.drivers.quobyte [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83210) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:25:12 devstack cinder-volume[83210]: DEBUG oslo_concurrency.lockutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.508s {{(pid=83210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:25:12 devstack cinder-volume[83210]: DEBUG oslo_concurrency.processutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:25:12 devstack sudo[83284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:25:12 devstack sudo[83284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:25:12 devstack sudo[83284]: pam_unix(sudo:session): session closed for user root Apr 16 13:25:12 devstack cinder-volume[83210]: DEBUG oslo_concurrency.processutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.386s {{(pid=83210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:25:12 devstack cinder-volume[83210]: INFO cinder.volume.driver [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Driver hasn't implemented _init_vendor_properties() Apr 16 13:25:12 devstack cinder-volume[83210]: DEBUG cinder.volume.driver [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327880859375, 'free_capacity_gb': 1775.7327880859375, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83210) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 13:25:12 devstack cinder-volume[83210]: DEBUG oslo_db.sqlalchemy.engines [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83210) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 13:25:12 devstack cinder-volume[83210]: DEBUG dbcounter [-] [83210] Writer thread running {{(pid=83210) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 13:25:12 devstack cinder-volume[83210]: DEBUG cinder.db.sqlalchemy.api [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Building query based on filter {{(pid=83210) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 13:25:12 devstack cinder-volume[83210]: DEBUG cinder.image.image_utils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83210) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 13:25:12 devstack cinder-volume[83210]: INFO cinder.keymgr.migration [None req-953b120a-d686-41a5-b82a-09ea14dd6495 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 13:25:12 devstack cinder-volume[83210]: DEBUG oslo_concurrency.lockutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:25:12 devstack cinder-volume[83210]: DEBUG oslo_concurrency.lockutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:25:12 devstack cinder-volume[83210]: DEBUG cinder.volume.drivers.quobyte [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83210) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:25:12 devstack cinder-volume[83210]: DEBUG cinder.volume.drivers.quobyte [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83210) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:25:12 devstack cinder-volume[83210]: DEBUG oslo_concurrency.lockutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:25:12 devstack cinder-volume[83210]: DEBUG oslo_concurrency.processutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:25:12 devstack sudo[83288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:25:12 devstack sudo[83288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:25:13 devstack sudo[83288]: pam_unix(sudo:session): session closed for user root Apr 16 13:25:13 devstack cinder-volume[83210]: DEBUG oslo_concurrency.processutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.377s {{(pid=83210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:25:13 devstack cinder-volume[83210]: DEBUG cinder.manager [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Notifying Schedulers of capabilities ... {{(pid=83210) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:25:13 devstack cinder-volume[83210]: INFO cinder.volume.manager [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Driver initialization completed successfully. Apr 16 13:25:13 devstack cinder-volume[83210]: INFO cinder.manager [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Initiating service 3 cleanup Apr 16 13:25:13 devstack cinder-volume[83210]: INFO cinder.manager [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Service 3 cleanup completed. Apr 16 13:25:13 devstack cinder-volume[83210]: DEBUG cinder.service [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Creating RPC server for service cinder-volume {{(pid=83210) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 13:25:13 devstack cinder-volume[83210]: DEBUG cinder.service [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83210) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 13:25:13 devstack cinder-volume[83210]: INFO cinder.volume.manager [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 16 13:25:13 devstack cinder-volume[83210]: DEBUG oslo_concurrency.lockutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:25:13 devstack cinder-volume[83210]: DEBUG oslo_concurrency.lockutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:25:13 devstack cinder-volume[83210]: DEBUG cinder.volume.drivers.quobyte [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83210) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:25:13 devstack cinder-volume[83210]: DEBUG cinder.volume.drivers.quobyte [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83210) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:25:13 devstack cinder-volume[83210]: DEBUG oslo_concurrency.lockutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:25:13 devstack cinder-volume[83210]: DEBUG oslo_concurrency.processutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:25:13 devstack sudo[83293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:25:13 devstack sudo[83293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:25:13 devstack sudo[83293]: pam_unix(sudo:session): session closed for user root Apr 16 13:25:13 devstack cinder-volume[83210]: DEBUG oslo_concurrency.processutils [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.590s {{(pid=83210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:25:13 devstack cinder-volume[83210]: INFO cinder.volume.manager [None req-9c482dc1-175d-42cd-8473-4bf7a32ec7a4 None None] Driver post RPC initialization completed successfully. Apr 16 13:25:16 devstack cinder-volume[83210]: DEBUG oslo_concurrency.lockutils [None req-5dc6ca8d-71ff-47dc-857b-2448b5b2dfa4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:25:16 devstack cinder-volume[83210]: DEBUG oslo_concurrency.lockutils [None req-5dc6ca8d-71ff-47dc-857b-2448b5b2dfa4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:25:16 devstack cinder-volume[83210]: DEBUG cinder.volume.drivers.quobyte [None req-5dc6ca8d-71ff-47dc-857b-2448b5b2dfa4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83210) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:25:16 devstack cinder-volume[83210]: DEBUG cinder.volume.drivers.quobyte [None req-5dc6ca8d-71ff-47dc-857b-2448b5b2dfa4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83210) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:25:16 devstack cinder-volume[83210]: DEBUG oslo_concurrency.lockutils [None req-5dc6ca8d-71ff-47dc-857b-2448b5b2dfa4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:25:16 devstack cinder-volume[83210]: DEBUG oslo_concurrency.processutils [None req-5dc6ca8d-71ff-47dc-857b-2448b5b2dfa4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:25:16 devstack sudo[83360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:25:16 devstack sudo[83360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:25:16 devstack sudo[83360]: pam_unix(sudo:session): session closed for user root Apr 16 13:25:16 devstack cinder-volume[83210]: DEBUG oslo_concurrency.processutils [None req-5dc6ca8d-71ff-47dc-857b-2448b5b2dfa4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.374s {{(pid=83210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:25:16 devstack cinder-volume[83210]: DEBUG cinder.manager [None req-5dc6ca8d-71ff-47dc-857b-2448b5b2dfa4 None None] Notifying Schedulers of capabilities ... {{(pid=83210) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:25:20 devstack cinder-volume[83010]: INFO oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Caught SIGTERM, stopping children Apr 16 13:25:20 devstack cinder-volume[83010]: DEBUG oslo_concurrency.lockutils [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Acquiring lock "singleton_lock" {{(pid=83010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 13:25:20 devstack cinder-volume[83010]: DEBUG oslo_concurrency.lockutils [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Acquired lock "singleton_lock" {{(pid=83010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 13:25:20 devstack cinder-volume[83010]: DEBUG oslo_concurrency.lockutils [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Releasing lock "singleton_lock" {{(pid=83010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 13:25:20 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Stop services. {{(pid=83010) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 16 13:25:20 devstack cinder-volume[83010]: DEBUG oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Killing children. {{(pid=83010) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 16 13:25:20 devstack cinder-volume[83010]: INFO oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Waiting on 1 children to exit Apr 16 13:25:21 devstack cinder-volume[83210]: DEBUG oslo_concurrency.lockutils [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Acquiring lock "singleton_lock" {{(pid=83210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 13:25:21 devstack cinder-volume[83210]: DEBUG oslo_concurrency.lockutils [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Acquired lock "singleton_lock" {{(pid=83210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 13:25:21 devstack cinder-volume[83210]: DEBUG oslo_concurrency.lockutils [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Releasing lock "singleton_lock" {{(pid=83210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 13:25:21 devstack cinder-volume[83210]: WARNING amqp [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 13:25:21 devstack cinder-volume[83210]: WARNING amqp [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 13:25:21 devstack cinder-volume[83010]: INFO oslo_service.backend._eventlet.service [None req-c1dac55b-5fd8-4fbc-88b6-78e826044eec None None] Child 83210 exited with status 0 Apr 16 13:25:21 devstack cinder-volume[83433]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 13:25:21 devstack cinder-volume[83433]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 13:25:21 devstack cinder-volume[83433]: we strongly recommend against using it for new projects. Apr 16 13:25:21 devstack cinder-volume[83433]: If you are already using Eventlet, we recommend migrating to a different Apr 16 13:25:21 devstack cinder-volume[83433]: framework. For more detail see Apr 16 13:25:21 devstack cinder-volume[83433]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 13:25:21 devstack cinder-volume[83433]: import eventlet # noqa Apr 16 13:25:23 devstack cinder-volume[83433]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83433) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 13:25:23 devstack cinder-volume[83433]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83433) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 13:25:23 devstack cinder-volume[83433]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83433) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 13:25:24 devstack cinder-volume[83433]: INFO dbcounter [None req-34108a70-c445-498e-8812-ebc7acad199b None None] Registered counter for database cinder Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_db.sqlalchemy.engines [None req-34108a70-c445-498e-8812-ebc7acad199b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83433) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG dbcounter [-] [83433] Writer thread running {{(pid=83433) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 13:25:24 devstack cinder-volume[83433]: INFO cinder.rpc [None req-34108a70-c445-498e-8812-ebc7acad199b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 13:25:24 devstack cinder-volume[83433]: INFO cinder.rpc [None req-34108a70-c445-498e-8812-ebc7acad199b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_db.sqlalchemy.engines [None req-34108a70-c445-498e-8812-ebc7acad199b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83433) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 13:25:24 devstack cinder-volume[83433]: INFO cinder.volume.manager [None req-34108a70-c445-498e-8812-ebc7acad199b None None] Determined volume DB was empty at startup. Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG cinder.volume.manager [None req-34108a70-c445-498e-8812-ebc7acad199b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83433) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 13:25:24 devstack cinder-volume[83433]: WARNING stevedore.named [None req-34108a70-c445-498e-8812-ebc7acad199b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 13:25:24 devstack cinder-volume[83433]: WARNING castellan.key_manager [None req-34108a70-c445-498e-8812-ebc7acad199b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 13:25:24 devstack cinder-volume[83433]: WARNING cinder.keymgr.conf_key_mgr [None req-34108a70-c445-498e-8812-ebc7acad199b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 13:25:24 devstack cinder-volume[83433]: INFO cinder.volume.manager [None req-34108a70-c445-498e-8812-ebc7acad199b None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_db.sqlalchemy.engines [None req-34108a70-c445-498e-8812-ebc7acad199b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83433) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 13:25:24 devstack cinder-volume[83433]: INFO oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] Starting 1 workers Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] Started child 83606 {{(pid=83433) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] Full set of CONF: {{(pid=83433) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] ******************************************************************************** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] Configuration options gathered from: {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] ================================================================================ {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] allow_availability_zone_fallback = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] allow_compression_on_image_upload = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] allowed_direct_url_schemes = [] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] api_rate_limit = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] auth_strategy = keystone {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_availability_zone = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_host = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_name = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_stats_polling_interval = 60 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backup_api_class = cinder.backup.api.API {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backup_name_template = backup-%s {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backup_use_same_host = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backup_use_temp_snapshot = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] chap_password = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] chap_username = {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cinder_internal_tenant_project_id = b56007aac0f144788b6f5730a897a51d {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cinder_internal_tenant_user_id = 3b493ce9a6184a6c8ca4aeb4dbd9ae28 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cluster = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] compression_format = gzip {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] compute_api_class = cinder.compute.nova.API {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] config_dir = [] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] config_source = [] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] control_exchange = openstack {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] debug = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] default_availability_zone = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] default_group_type = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] default_volume_type = QuobyteHD {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] disk_geometry = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] driver_client_cert = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] driver_client_cert_key = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] driver_data_namespace = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] driver_ssl_cert_path = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83606]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] driver_ssl_cert_verify = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] driver_use_ssl = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] enable_new_services = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] enable_unsupported_driver = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] enabled_backends = ['QuobyteHD'] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] enforce_multipath_for_image_xfer = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] filter_function = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance_api_insecure = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance_api_servers = ['http://192.168.122.253/image'] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance_api_ssl_compression = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance_ca_certificates_file = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance_catalog_info = image:glance:publicURL {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance_certfile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance_keyfile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance_num_retries = 3 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance_request_timeout = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] goodness_function = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] graceful_shutdown_timeout = 5 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] group_api_class = cinder.group.api.API {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] host = devstack {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] image_compress_on_upload = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] image_conversion_address_space_limit = 1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] image_conversion_cpu_limit = 60 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] image_conversion_disable = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] image_upload_use_cinder_backend = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] image_upload_use_internal_tenant = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] image_volume_cache_enabled = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] image_volume_cache_max_count = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] image_volume_cache_max_size_gb = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] init_host_max_objects_retrieval = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] instance_format = [instance: %(uuid)s] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] iscsi_target_flags = {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] iscsi_write_cache = on {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] iser_helper = tgtadm {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] iser_ip_address = 192.168.122.253 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] iser_port = 3260 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] log_color = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] log_config_append = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] log_dir = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] log_file = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] log_options = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] log_rotate_interval = 1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] log_rotate_interval_type = days {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] log_rotation_type = none {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] max_age = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] max_logfile_count = 30 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] max_logfile_size_mb = 200 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] max_over_subscription_ratio = 20.0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] message_reap_interval = 86400 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] message_ttl = 2592000 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] migration_create_volume_timeout_secs = 300 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] monkey_patch = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] monkey_patch_modules = [] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] my_ip = 192.168.122.253 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] no_snapshot_gb_quota = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] num_iser_scan_tries = 3 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] num_shell_tries = 3 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] num_volume_device_scan_tries = 3 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] nvmeof_conn_info_version = 1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] nvmet_ns_id = 10 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] nvmet_port_id = 1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] osapi_max_limit = 1000 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] osapi_volume_ext_list = [] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] osapi_volume_listen = 0.0.0.0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] osapi_volume_listen_port = 8776 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] osapi_volume_use_ssl = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] osapi_volume_workers = 2 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] per_volume_size_limit = -1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] periodic_fuzzy_delay = 60 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] periodic_interval = 60 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] project_id_regex = [0-9a-f\-]+ {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] public_endpoint = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] publish_errors = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] quota_backup_gigabytes = 1000 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] quota_backups = 10 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] quota_gigabytes = 1000 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] quota_groups = 10 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] quota_snapshots = 10 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] quota_volumes = 10 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] rate_limit_burst = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] rate_limit_except_level = CRITICAL {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] rate_limit_interval = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] reinit_driver_count = 3 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] replication_device = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] report_discard_supported = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] report_interval = 120 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Starting volume driver QuobyteDriver (1.1.14) Apr 16 13:25:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83606) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] reservation_clean_interval = 86400 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] reservation_expire = 86400 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] reserved_image_namespaces = [] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] reserved_percentage = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] rpc_response_timeout = 120 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] run_external_periodic_tasks = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] scst_target_driver = iscsi {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] scst_target_iqn_name = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] service_down_time = 720 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] shell_completion = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] snapshot_name_template = snapshot-%s {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] split_loggers = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] state_path = /opt/stack/data/cinder {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] storage_availability_zone = nova {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] storage_protocol = iSCSI {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] syslog_log_facility = LOG_USER {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] target_helper = lioadm {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] target_ip_address = 192.168.122.253 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] target_port = 3260 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] target_protocol = iscsi {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] target_secondary_ip_addresses = [] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] trace_flags = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] transfer_api_class = cinder.transfer.api.API {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] transport_url = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] until_refresh = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] use_chap_auth = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] use_default_quota_class = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] use_journal = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] use_json = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] use_multipath_for_image_xfer = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] use_stderr = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] use_syslog = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] verify_glance_signatures = enabled {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] volume_api_class = cinder.volume.api.API {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] volume_backend_name = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] volume_clear = zero {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] volume_clear_ionice = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] volume_clear_size = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] volume_copy_bps_limit = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] volume_dd_blocksize = 1M {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] volume_name_template = volume-%s {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] volume_service_inithost_offload = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] volume_usage_audit_period = month {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] zoning_mode = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_concurrency.disable_process_locking = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.admin_password = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.admin_token = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.admin_user = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.auth_admin_prefix = {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.auth_port = 35357 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.auth_protocol = https {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.auth_section = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.auth_type = password {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.auth_uri = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.auth_version = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.cache = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.certfile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.delay_auth_decision = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.http_connect_timeout = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.identity_uri = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.include_service_catalog = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.insecure = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.interface = public {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.keyfile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.memcache_password = {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.memcache_username = {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.region_name = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.service_token_roles_required = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.service_type = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.token_cache_time = 300 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.253/identity {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.backend = dogpile.cache.null {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.backend_argument = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.backend_expiration_time = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.config_prefix = cache.oslo {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.debug_cache_backend = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.enable_retry_client = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.enable_socket_keepalive = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.enabled = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.enforce_fips_mode = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.expiration_time = 600 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.hashclient_retry_attempts = 2 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.memcache_dead_retry = 300 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.memcache_pool_maxsize = 10 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.memcache_sasl_enabled = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.password = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.proxies = [] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.redis_db = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.redis_sentinel_service_name = mymaster {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.redis_server = localhost:6379 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.retry_attempts = 2 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.retry_delay = 0.0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.socket_keepalive_count = 1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.socket_keepalive_idle = 1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.socket_keepalive_interval = 1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.socket_timeout = 1.0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.tls_allowed_ciphers = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.tls_cafile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.tls_certfile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.tls_enabled = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.tls_keyfile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cache.username = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] coordination.backend_url = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.asyncio_connection = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.asyncio_slave_connection = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.backend = sqlalchemy {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.connection = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.connection_debug = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.connection_parameters = {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.connection_recycle_time = 3600 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.connection_trace = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.db_inc_retry_interval = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.db_max_retries = 20 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.db_max_retry_interval = 10 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.db_retry_interval = 1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.max_overflow = 50 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.max_pool_size = 5 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.max_retries = 10 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83606) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 16 13:25:24 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.quobyte [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 16 13:25:24 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.quobyte [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 16 13:25:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Running cmd (subprocess): mount.quobyte {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.mysql_wsrep_sync_wait = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.pool_timeout = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.retry_interval = 10 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.slave_connection = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.sqlite_synchronous = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.synchronous_reader = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] database.use_db_reconnect = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] profiler.connection_string = messaging:// {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] profiler.enabled = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] profiler.es_doc_type = notification {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] profiler.es_scroll_size = 10000 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] profiler.es_scroll_time = 2m {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] profiler.filter_error_trace = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] profiler.hmac_keys = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] profiler.sentinel_service_name = mymaster {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] profiler.socket_timeout = 0.1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] profiler.trace_requests = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] profiler.trace_sqlalchemy = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] profiler_jaeger.process_tags = {} {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] profiler_jaeger.service_name_prefix = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] profiler_otlp.service_name_prefix = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_policy.enforce_new_defaults = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: WARNING oslo_config.cfg [None req-34108a70-c445-498e-8812-ebc7acad199b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_policy.enforce_scope = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_policy.policy_default_rule = default {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_policy.policy_file = policy.yaml {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_policy.remote_timeout = 60.0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] privsep_osbrick.group = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] privsep_osbrick.helper_command = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] privsep_osbrick.user = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cinder_sys_admin.group = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cinder_sys_admin.helper_command = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] cinder_sys_admin.user = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] service_user.auth_section = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] service_user.auth_type = password {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] service_user.cafile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] service_user.certfile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] service_user.collect_timing = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] service_user.insecure = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] service_user.keyfile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] service_user.send_service_user_token = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] service_user.split_loggers = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] service_user.timeout = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance.auth_section = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance.auth_type = password {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance.certfile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance.collect_timing = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance.insecure = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance.keyfile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance.region_name = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance.split_loggers = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] glance.timeout = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.backend_availability_zone = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.chap_password = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.chap_username = {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.disk_geometry = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.driver_client_cert = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.driver_client_cert_key = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.driver_data_namespace = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.driver_use_ssl = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.enable_unsupported_driver = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.extra_capabilities = {} {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.filter_function = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.goodness_function = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.iscsi_target_flags = {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.iscsi_write_cache = on {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.iser_helper = tgtadm {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.iser_ip_address = 192.168.122.253 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.iser_port = 3260 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.nas_host = {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.nas_login = admin {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.nas_mount_options = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.nas_password = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.nas_private_key = {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.nas_share_path = {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.nas_ssh_port = 22 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.num_shell_tries = 3 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.nvmet_port_id = 1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.quobyte_client_cfg = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.quobyte_volume_url = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.replication_device = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.report_discard_supported = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.reserved_percentage = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.scst_target_driver = iscsi {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.scst_target_iqn_name = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.storage_protocol = iSCSI {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.target_helper = tgtadm {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.target_ip_address = 192.168.122.253 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.target_port = 3260 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.target_protocol = iscsi {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.trace_flags = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.unique_fqdn_network = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.use_chap_auth = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.volume_backend_name = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.volume_clear = zero {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.volume_clear_ionice = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.volume_clear_size = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_reports.file_event_handler = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_reports.log_dir = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.backend_availability_zone = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.backend_host = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.chap_password = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.chap_username = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.chiscsi_conf = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.disk_geometry = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.driver_client_cert = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.driver_client_cert_key = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.driver_data_namespace = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.driver_use_ssl = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.extra_capabilities = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.filter_function = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.goodness_function = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.iscsi_target_flags = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.iscsi_write_cache = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.iser_helper = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.iser_ip_address = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.iser_port = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.iser_target_prefix = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.nas_host = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.nas_login = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.nas_mount_options = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.nas_password = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.nas_private_key = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.nas_share_path = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.nas_ssh_port = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.num_shell_tries = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.nvmet_ns_id = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.nvmet_port_id = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.replication_device = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.report_discard_supported = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.reserved_percentage = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.scst_target_driver = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.storage_protocol = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.target_helper = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.target_ip_address = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.target_port = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.target_prefix = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.target_protocol = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.trace_flags = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.unique_fqdn_network = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.use_chap_auth = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.volume_clear = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.volume_clear_ionice = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.volume_clear_size = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] QuobyteHD.volumes_dir = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.ssl = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.ssl_version = {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_notifications.driver = [] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_notifications.retry = -1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack quobyte-client[83626]: Reading configuration file: /etc/quobyte/client.cfg Apr 16 13:25:24 devstack quobyte-client[83626]: Invalid parameters found, error: missing mount point. Apr 16 13:25:24 devstack quobyte-client[83626]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 16 13:25:24 devstack quobyte-client[83626]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] oslo_messaging_notifications.transport_url = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] key_manager.fixed_key = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] CMD "mount.quobyte" returned: 1 in 0.128s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:25:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:25:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:25:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican.barbican_api_version = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican.barbican_endpoint = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:25:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:25:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican.barbican_endpoint_type = public {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican.barbican_region_name = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican.cafile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican.certfile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican.collect_timing = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican.insecure = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican.keyfile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican.number_of_retries = 60 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican.retry_delay = 1 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican.send_service_user_token = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican.split_loggers = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican.timeout = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican.verify_ssl = True {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican.verify_ssl_path = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican_service_user.auth_section = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican_service_user.auth_type = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican_service_user.cafile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican_service_user.certfile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican_service_user.collect_timing = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican_service_user.insecure = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican_service_user.keyfile = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican_service_user.split_loggers = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] barbican_service_user.timeout = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] vault.approle_role_id = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] vault.approle_secret_id = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] vault.kv_mountpoint = secret {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] vault.kv_path = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] vault.kv_version = 2 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] vault.namespace = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] vault.root_token_id = **** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] vault.ssl_ca_crt_file = None {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] vault.timeout = 60.0 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] vault.use_ssl = False {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 13:25:24 devstack cinder-volume[83433]: DEBUG oslo_service.backend._eventlet.service [None req-34108a70-c445-498e-8812-ebc7acad199b None None] ******************************************************************************** {{(pid=83433) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 13:25:24 devstack sudo[83636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:25:24 devstack sudo[83636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:25:25 devstack sudo[83636]: pam_unix(sudo:session): session closed for user root Apr 16 13:25:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.539s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:25:25 devstack cinder-volume[83606]: INFO cinder.volume.driver [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Driver hasn't implemented _init_vendor_properties() Apr 16 13:25:25 devstack cinder-volume[83606]: DEBUG cinder.volume.driver [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327880859375, 'free_capacity_gb': 1775.7327880859375, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83606) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 13:25:25 devstack cinder-volume[83606]: DEBUG oslo_db.sqlalchemy.engines [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83606) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 13:25:25 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writer thread running {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 13:25:25 devstack cinder-volume[83606]: DEBUG cinder.db.sqlalchemy.api [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Building query based on filter {{(pid=83606) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 13:25:25 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83606) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 13:25:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:25:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:25:25 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:25:25 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:25:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:25:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:25:25 devstack cinder-volume[83606]: INFO cinder.keymgr.migration [None req-347d07d8-5df4-4337-84d6-d587315dd783 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 13:25:25 devstack sudo[83663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:25:25 devstack sudo[83663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:25:26 devstack sudo[83663]: pam_unix(sudo:session): session closed for user root Apr 16 13:25:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.590s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:25:26 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:25:26 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Driver initialization completed successfully. Apr 16 13:25:26 devstack cinder-volume[83606]: INFO cinder.manager [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Initiating service 3 cleanup Apr 16 13:25:26 devstack cinder-volume[83606]: INFO cinder.manager [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Service 3 cleanup completed. Apr 16 13:25:26 devstack cinder-volume[83606]: DEBUG cinder.service [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Creating RPC server for service cinder-volume {{(pid=83606) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 13:25:26 devstack cinder-volume[83606]: DEBUG cinder.service [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83606) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 13:25:26 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 16 13:25:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:25:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:25:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:25:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:25:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:25:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:25:26 devstack sudo[83687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:25:26 devstack sudo[83687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:25:26 devstack sudo[83687]: pam_unix(sudo:session): session closed for user root Apr 16 13:25:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.393s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:25:26 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-a90ba5f9-5252-4982-8307-4674ee5df11a None None] Driver post RPC initialization completed successfully. Apr 16 13:25:34 devstack cinder-volume[83433]: DEBUG dbcounter [-] [83433] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83433) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:25:35 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:SELECT=2 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:25:36 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Flow 'volume_create_manager' (71485131-b4c4-4635-a58c-a292e8925870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b01890e-c5a7-4585-a707-45a38dc65ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b01890e-c5a7-4585-a707-45a38dc65ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2043658694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f436a7-41df-46d1-a437-62bed34c8afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f0c64dde6c547f5a073814cc2e0db15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:26:25Z,use_quota=True,user_id='26191c0372eb4a4f9fcb951ca8f5cd41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1bbc673-dbb3-4254-b65d-d3c9fbee4dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1bbc673-dbb3-4254-b65d-d3c9fbee4dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4e5e81-f982-4ffb-a547-88d1b1095030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4e5e81-f982-4ffb-a547-88d1b1095030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2f436a7-41df-46d1-a437-62bed34c8afe', 'volume_name': 'volume-f2f436a7-41df-46d1-a437-62bed34c8afe', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b387243-c217-429d-a64e-742a9cb9d7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b387243-c217-429d-a64e-742a9cb9d7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3c317f-06f1-48a4-87b7-4ea896a10bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:25 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Volume f2f436a7-41df-46d1-a437-62bed34c8afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2f436a7-41df-46d1-a437-62bed34c8afe', 'volume_size': 1} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2043658694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f436a7-41df-46d1-a437-62bed34c8afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f0c64dde6c547f5a073814cc2e0db15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:26:25Z,use_quota=True,user_id='26191c0372eb4a4f9fcb951ca8f5cd41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Creating volume f2f436a7-41df-46d1-a437-62bed34c8afe {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:26:25 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:26:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f2f436a7-41df-46d1-a437-62bed34c8afe 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:25 devstack sudo[84056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f2f436a7-41df-46d1-a437-62bed34c8afe 1073741824 Apr 16 13:26:25 devstack sudo[84056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:26 devstack sudo[84056]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f2f436a7-41df-46d1-a437-62bed34c8afe 1073741824" returned: 0 in 1.163s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f2f436a7-41df-46d1-a437-62bed34c8afe {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:26 devstack sudo[84375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f2f436a7-41df-46d1-a437-62bed34c8afe Apr 16 13:26:26 devstack sudo[84375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:27 devstack sudo[84375]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f2f436a7-41df-46d1-a437-62bed34c8afe" returned: 0 in 0.763s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:26:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3c317f-06f1-48a4-87b7-4ea896a10bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2f436a7-41df-46d1-a437-62bed34c8afe', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd749ef3-ab26-48f7-97ec-fbec06af9aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:27 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Volume volume-f2f436a7-41df-46d1-a437-62bed34c8afe (f2f436a7-41df-46d1-a437-62bed34c8afe): created successfully Apr 16 13:26:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd749ef3-ab26-48f7-97ec-fbec06af9aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Flow 'volume_create_manager' (71485131-b4c4-4635-a58c-a292e8925870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:26:27 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d6150e76-5577-4844-9d01-b2fd90b76e49 tempest-VolumesAdminNegativeTest-21331636 None] Created volume successfully. Apr 16 13:26:28 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-c281513f-40d9-4f59-9251-46879a2eeae4 tempest-GroupSnapshotsTest-1532467286 None] Group tempest-GroupSnapshotsTest-Group-719233942: creating Apr 16 13:26:28 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-c281513f-40d9-4f59-9251-46879a2eeae4 tempest-GroupSnapshotsTest-1532467286 None] Group tempest-GroupSnapshotsTest-Group-719233942: created successfully Apr 16 13:26:28 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-c281513f-40d9-4f59-9251-46879a2eeae4 tempest-GroupSnapshotsTest-1532467286 None] Create group completed successfully. Apr 16 13:26:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Acquiring lock "cinder-f2f436a7-41df-46d1-a437-62bed34c8afe-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:26:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Lock "cinder-f2f436a7-41df-46d1-a437-62bed34c8afe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:26:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Acquiring lock "cinder-quobyte-f2f436a7-41df-46d1-a437-62bed34c8afe" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:26:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Lock "cinder-quobyte-f2f436a7-41df-46d1-a437-62bed34c8afe" acquired by "delete_volume" :: waited 0.020s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:26:28 devstack cinder-volume[83606]: INFO oslo.privsep.daemon [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpjrh0f9vu/privsep.sock'] Apr 16 13:26:28 devstack sudo[84381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpjrh0f9vu/privsep.sock Apr 16 13:26:28 devstack sudo[84381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:29 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 16 13:26:29 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 13:26:29 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 16 13:26:29 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 13:26:29 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 16 13:26:29 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 16 13:26:29 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 13:26:29 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 13:26:29 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Flow 'volume_create_manager' (bf3c84b1-b970-4020-b1fa-fbc98f5faf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e81ca3c-79d5-4abd-86b5-a23c351bfcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e81ca3c-79d5-4abd-86b5-a23c351bfcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1529898183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f38e235-000c-4114-803f-5307f9947eb8,host='devstack@QuobyteHD#QuobyteHD',id=678b2d63-a905-4613-9a03-b7c4e340d20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085ce34bb5314c07a4039dd1006aa8de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:26:30Z,use_quota=True,user_id='3cd2135733444c01be9145f2e00c61fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6cb0d1a-ac69-4480-98a4-279f1d8cf8dc),volume_type_id=a6cb0d1a-ac69-4480-98a4-279f1d8cf8dc)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8602b04-a0e1-462e-90ca-3ab4b713544e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8602b04-a0e1-462e-90ca-3ab4b713544e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c4305f-9b7a-41d2-923a-7242663bd388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c4305f-9b7a-41d2-923a-7242663bd388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '678b2d63-a905-4613-9a03-b7c4e340d20e', 'volume_name': 'volume-678b2d63-a905-4613-9a03-b7c4e340d20e', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefc19fc-137c-4daa-a026-5363ba0ebb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefc19fc-137c-4daa-a026-5363ba0ebb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438d5faf-d868-41e0-ae48-65add85f6b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:30 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Volume 678b2d63-a905-4613-9a03-b7c4e340d20e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-678b2d63-a905-4613-9a03-b7c4e340d20e', 'volume_size': 1} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3f38e235-000c-4114-803f-5307f9947eb8,created_at=2026-04-16T11:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1529898183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f38e235-000c-4114-803f-5307f9947eb8,host='devstack@QuobyteHD#QuobyteHD',id=678b2d63-a905-4613-9a03-b7c4e340d20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085ce34bb5314c07a4039dd1006aa8de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:26:30Z,use_quota=True,user_id='3cd2135733444c01be9145f2e00c61fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6cb0d1a-ac69-4480-98a4-279f1d8cf8dc),volume_type_id=a6cb0d1a-ac69-4480-98a4-279f1d8cf8dc)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Creating volume 678b2d63-a905-4613-9a03-b7c4e340d20e {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:26:30 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:30 devstack sudo[84389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e 1073741824 Apr 16 13:26:30 devstack sudo[84389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:30 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 16 13:26:30 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 13:26:30 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 16 13:26:30 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 13:26:30 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 16 13:26:30 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 16 13:26:30 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 13:26:30 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 13:26:30 devstack cinder-volume[83606]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 16 13:26:30 devstack sudo[84381]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:30 devstack cinder-volume[83606]: INFO oslo.privsep.daemon [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Spawned new privsep daemon via rootwrap Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Accepted privsep connection to /tmp/tmpjrh0f9vu/privsep.sock {{(pid=83606) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 16 13:26:30 devstack cinder-volume[83606]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 16 13:26:30 devstack cinder-volume[83606]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 16 13:26:30 devstack cinder-volume[83606]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 16 13:26:30 devstack cinder-volume[83606]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84391 Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[050ad56f-f29d-4ad1-94e6-456de5afb804]: (2,) {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2debd02d-ec39-490b-99e0-3af6032efdea]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f2f436a7-41df-46d1-a437-62bed34c8afe {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:30 devstack sudo[84389]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e 1073741824" returned: 0 in 0.723s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:31 devstack sudo[84416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e Apr 16 13:26:31 devstack sudo[84416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:31 devstack sudo[84396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f2f436a7-41df-46d1-a437-62bed34c8afe Apr 16 13:26:31 devstack sudo[84396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:32 devstack sudo[84416]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e" returned: 0 in 1.074s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438d5faf-d868-41e0-ae48-65add85f6b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-678b2d63-a905-4613-9a03-b7c4e340d20e', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab81fe3-7d28-468b-a945-742d1ae0c569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:32 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Volume volume-678b2d63-a905-4613-9a03-b7c4e340d20e (678b2d63-a905-4613-9a03-b7c4e340d20e): created successfully Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab81fe3-7d28-468b-a945-742d1ae0c569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Flow 'volume_create_manager' (bf3c84b1-b970-4020-b1fa-fbc98f5faf9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:26:32 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-eafd80a0-6b92-4308-b639-52f2ddf16b89 tempest-GroupSnapshotsTest-1532467286 None] Created volume successfully. Apr 16 13:26:32 devstack sudo[84396]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f2f436a7-41df-46d1-a437-62bed34c8afe" returned: 0 in 1.355s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f2f436a7-41df-46d1-a437-62bed34c8afe {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:32 devstack sudo[84431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f2f436a7-41df-46d1-a437-62bed34c8afe Apr 16 13:26:32 devstack sudo[84431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Flow 'volume_create_manager' (6a8ff30d-4288-4a8c-b3b8-129690410319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e35e74-b8c2-4825-ae33-99f65c8cfb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e35e74-b8c2-4825-ae33-99f65c8cfb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2099486841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98fa551-5b30-4a5c-bba2-27607bc8f1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8014bf9eddda40f19152418d3139c6ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:26:32Z,use_quota=True,user_id='ce617a778fe140c7b397f0fd222d0790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace8cb47-065d-4816-8ed3-1d3497765997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace8cb47-065d-4816-8ed3-1d3497765997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e2d968-9379-4ab6-b4c0-6a3fc4a566be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e2d968-9379-4ab6-b4c0-6a3fc4a566be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f98fa551-5b30-4a5c-bba2-27607bc8f1fa', 'volume_name': 'volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b8bee33-6a89-4e5a-881f-839b46d73833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b8bee33-6a89-4e5a-881f-839b46d73833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3c3340-5cf8-4ed3-ad4d-025447e5c11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:32 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Volume f98fa551-5b30-4a5c-bba2-27607bc8f1fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa', 'volume_size': 1} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2099486841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98fa551-5b30-4a5c-bba2-27607bc8f1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8014bf9eddda40f19152418d3139c6ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:26:32Z,use_quota=True,user_id='ce617a778fe140c7b397f0fd222d0790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Creating volume f98fa551-5b30-4a5c-bba2-27607bc8f1fa {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:26:32 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:26:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:32 devstack sudo[84434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa 1073741824 Apr 16 13:26:32 devstack sudo[84434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:33 devstack sudo[84431]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f2f436a7-41df-46d1-a437-62bed34c8afe" returned: 0 in 1.015s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:33 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] GroupSnapshot eb06fa7b-388c-42a7-b92a-fb754f7246fc: creating. Apr 16 13:26:33 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Lock "cinder-quobyte-f2f436a7-41df-46d1-a437-62bed34c8afe" released by "delete_volume" :: held 4.453s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:26:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] Group snapshot eb06fa7b-388c-42a7-b92a-fb754f7246fc: creating. {{(pid=83606) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 13:26:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:33 devstack cinder-volume[83606]: WARNING cinder.quota [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:26:33 devstack cinder-volume[83606]: WARNING cinder.quota [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:26:33 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Created reservations ['b977f1a7-47c0-416d-9e4c-b203d125f35f', '485d8d8f-bca0-4c76-aa81-378408a7880d', 'be05a584-d855-416b-af1d-3c771d61a3f5', '98b8c7af-b9ba-4ccf-8ed8-30fd525b5041'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:26:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:33 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:26:33 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:26:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:33 devstack sudo[84442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:26:33 devstack sudo[84442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:34 devstack sudo[84442]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.447s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:34 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:26:34 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Deleted volume successfully. Apr 16 13:26:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7c5e80c5-f7f9-4672-b4da-ded4431daafa tempest-VolumesAdminNegativeTest-21331636 None] Lock "cinder-f2f436a7-41df-46d1-a437-62bed34c8afe-delete_volume" released by "delete_volume" :: held 5.313s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:26:34 devstack sudo[84434]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa 1073741824" returned: 0 in 1.675s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:34 devstack sudo[84446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa Apr 16 13:26:34 devstack sudo[84446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:34 devstack cinder-volume[83606]: DEBUG oslo_service.periodic_task [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83606) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 13:26:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:26:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:26:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:34 devstack sudo[84448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:26:34 devstack sudo[84448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:35 devstack sudo[84446]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa" returned: 0 in 1.027s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] <== create_volume: return (2756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:26:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.758s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.899s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:35 devstack sudo[84448]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] Creating offline snapshot c4d7f127-2575-4479-9774-ba19c413885a of volume 678b2d63-a905-4613-9a03-b7c4e340d20e {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:26:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.868s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:35 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:26:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3c3340-5cf8-4ed3-ad4d-025447e5c11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b615891e-de21-436b-a95f-e742ff7789e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:35 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Volume volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa (f98fa551-5b30-4a5c-bba2-27607bc8f1fa): created successfully Apr 16 13:26:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b615891e-de21-436b-a95f-e742ff7789e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Flow 'volume_create_manager' (6a8ff30d-4288-4a8c-b3b8-129690410319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:26:35 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccc979f-be58-443d-a175-fef49b74714a]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:26:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:35 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-2ef9be77-5767-475a-aef2-a6d9acbe1378 tempest-DeleteServersTestJSON-1519581918 None] Created volume successfully. Apr 16 13:26:35 devstack sudo[84452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e Apr 16 13:26:35 devstack sudo[84452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:36 devstack sudo[84452]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e" returned: 0 in 1.146s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:36 devstack sudo[84509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a 1G Apr 16 13:26:36 devstack sudo[84509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:37 devstack sudo[84509]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a 1G" returned: 0 in 0.912s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678b2d63-a905-4613-9a03-b7c4e340d20e -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:37 devstack sudo[84524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678b2d63-a905-4613-9a03-b7c4e340d20e -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a Apr 16 13:26:37 devstack sudo[84524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:38 devstack sudo[84524]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678b2d63-a905-4613-9a03-b7c4e340d20e -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a" returned: 0 in 0.532s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:38 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a is being set with open permissions: ugo+rw: NotImplementedError Apr 16 13:26:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:38 devstack sudo[84532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a Apr 16 13:26:38 devstack sudo[84532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:38 devstack sudo[84532]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a" returned: 0 in 0.627s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:38 devstack sudo[84552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.info Apr 16 13:26:38 devstack sudo[84552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:39 devstack sudo[84552]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.info" returned: 0 in 0.651s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:39 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 13:26:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:39 devstack sudo[84559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.info Apr 16 13:26:39 devstack sudo[84559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:39 devstack sudo[84559]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.info" returned: 0 in 0.507s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.657s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:39 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-02d14e05-4fb3-4cf6-a901-294144edfe53 tempest-GroupSnapshotsTest-1532467286 None] group_snapshot eb06fa7b-388c-42a7-b92a-fb754f7246fc: created successfully Apr 16 13:26:40 devstack cinder-volume[83606]: WARNING py.warnings [req-a63cbb0d-5468-444a-843d-510ce738b6ad req-8ac34af4-4988-4301-b314-427a31e33779 tempest-DeleteServersTestJSON-1519581918 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 16 13:26:40 devstack cinder-volume[83606]: .first() Apr 16 13:26:40 devstack cinder-volume[83606]: Apr 16 13:26:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-a63cbb0d-5468-444a-843d-510ce738b6ad req-8ac34af4-4988-4301-b314-427a31e33779 tempest-DeleteServersTestJSON-1519581918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-a63cbb0d-5468-444a-843d-510ce738b6ad req-8ac34af4-4988-4301-b314-427a31e33779 tempest-DeleteServersTestJSON-1519581918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:40 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c3bc40-bd5e-4fd4-b9ee-0274e752f5d0]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:26:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-a63cbb0d-5468-444a-843d-510ce738b6ad req-8ac34af4-4988-4301-b314-427a31e33779 tempest-DeleteServersTestJSON-1519581918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:40 devstack sudo[84574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa Apr 16 13:26:40 devstack sudo[84574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:41 devstack sudo[84574]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-a63cbb0d-5468-444a-843d-510ce738b6ad req-8ac34af4-4988-4301-b314-427a31e33779 tempest-DeleteServersTestJSON-1519581918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa" returned: 0 in 0.480s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-a63cbb0d-5468-444a-843d-510ce738b6ad req-8ac34af4-4988-4301-b314-427a31e33779 tempest-DeleteServersTestJSON-1519581918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.523s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-a63cbb0d-5468-444a-843d-510ce738b6ad req-8ac34af4-4988-4301-b314-427a31e33779 tempest-DeleteServersTestJSON-1519581918 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912', 'name': 'volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99ed7483-2714-4d8e-ab60-be3358df01dc', 'enforce_multipath': True} {{(pid=83606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 13:26:41 devstack cinder-volume[83606]: INFO cinder.volume.manager [req-a63cbb0d-5468-444a-843d-510ce738b6ad req-8ac34af4-4988-4301-b314-427a31e33779 tempest-DeleteServersTestJSON-1519581918 None] attachment_update completed successfully. Apr 16 13:26:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:41 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "cinder-quobyte-c4d7f127-2575-4479-9774-ba19c413885a-fe6127c7-1e60-42d4-a2b0-f9e2844ab183" by "_create_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:26:41 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-c4d7f127-2575-4479-9774-ba19c413885a-fe6127c7-1e60-42d4-a2b0-f9e2844ab183" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:26:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Creating volume fe6127c7-1e60-42d4-a2b0-f9e2844ab183 from snapshot c4d7f127-2575-4479-9774-ba19c413885a {{(pid=83606) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 13:26:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:26:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:26:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:26:41 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "cinder-quobyte-fe6127c7-1e60-42d4-a2b0-f9e2844ab183" by "_copy_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:26:41 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-fe6127c7-1e60-42d4-a2b0-f9e2844ab183" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:26:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] snapshot: c4d7f127-2575-4479-9774-ba19c413885a, volume: fe6127c7-1e60-42d4-a2b0-f9e2844ab183, {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 13:26:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:26:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:26:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:42 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb97bf9-8c70-420c-9126-d0bd108eecf9]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:26:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:42 devstack sudo[84581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a Apr 16 13:26:42 devstack sudo[84581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:42 devstack sudo[84581]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a" returned: 0 in 0.635s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-678b2d63-a905-4613-9a03-b7c4e340d20e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:26:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 13:26:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Creating direct copy from snapshot {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 13:26:42 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4473125e-16a2-4a54-aabe-c8595617c68f]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:26:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:42 devstack sudo[84653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e Apr 16 13:26:42 devstack sudo[84653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:43 devstack sudo[84653]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e" returned: 0 in 1.081s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:43 devstack cinder-volume[83606]: DEBUG cinder.utils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Path /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-fe6127c7-1e60-42d4-a2b0-f9e2844ab183 not found in is_blk_device check {{(pid=83606) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 13:26:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-fe6127c7-1e60-42d4-a2b0-f9e2844ab183 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:43 devstack sudo[84978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-fe6127c7-1e60-42d4-a2b0-f9e2844ab183 Apr 16 13:26:43 devstack sudo[84978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:43 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:26:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Flow 'volume_create_manager' (81842cd5-33cf-4dd7-ae26-ff034692dc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:26:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fc333f-1746-4467-9d74-cb5fd9ae7692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fc333f-1746-4467-9d74-cb5fd9ae7692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-578150182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f07ba0ca-0e81-45b5-ac04-20ee6d993654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca44568fdbd044848f9d34f23744dfdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:26:44Z,use_quota=True,user_id='7e4ab0865cee4ea2b18ae5c03e3deb16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35429c55-5732-4fab-9931-00873ad2ba92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35429c55-5732-4fab-9931-00873ad2ba92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5296328e-742e-422d-b2ad-8556f9ea267d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5296328e-742e-422d-b2ad-8556f9ea267d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f07ba0ca-0e81-45b5-ac04-20ee6d993654', 'volume_name': 'volume-f07ba0ca-0e81-45b5-ac04-20ee6d993654', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbe319d-18bc-4815-bb08-d61bb7a8fd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbe319d-18bc-4815-bb08-d61bb7a8fd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cd5eba-5842-4532-a880-7d3703cb02ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:44 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Volume f07ba0ca-0e81-45b5-ac04-20ee6d993654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f07ba0ca-0e81-45b5-ac04-20ee6d993654', 'volume_size': 1} Apr 16 13:26:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:48 devstack sudo[84978]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-fe6127c7-1e60-42d4-a2b0-f9e2844ab183" returned: 0 in 4.483s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:48 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2eee5ed-4ca1-4c86-b6a4-9cafbb2197e4]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:26:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:48 devstack sudo[85006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e Apr 16 13:26:48 devstack sudo[85006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:49 devstack sudo[85006]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e" returned: 0 in 0.886s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:49 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Image conversion details: src /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e, size 1024.00 MB, duration 4.48 sec, destination /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-fe6127c7-1e60-42d4-a2b0-f9e2844ab183 {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:26:49 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Converted 1024.00 MB image at 228.39 MB/s Apr 16 13:26:49 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-fe6127c7-1e60-42d4-a2b0-f9e2844ab183 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 13:26:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-fe6127c7-1e60-42d4-a2b0-f9e2844ab183 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:49 devstack sudo[85040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-fe6127c7-1e60-42d4-a2b0-f9e2844ab183 Apr 16 13:26:49 devstack sudo[85040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:49 devstack sudo[85040]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-fe6127c7-1e60-42d4-a2b0-f9e2844ab183" returned: 0 in 0.546s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-fe6127c7-1e60-42d4-a2b0-f9e2844ab183" released by "_copy_volume_from_snapshot" :: held 7.877s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:26:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-c4d7f127-2575-4479-9774-ba19c413885a-fe6127c7-1e60-42d4-a2b0-f9e2844ab183" released by "_create_volume_from_snapshot" :: held 7.907s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:26:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.919s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.644s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-578150182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f07ba0ca-0e81-45b5-ac04-20ee6d993654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca44568fdbd044848f9d34f23744dfdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:26:44Z,use_quota=True,user_id='7e4ab0865cee4ea2b18ae5c03e3deb16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:26:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Creating volume f07ba0ca-0e81-45b5-ac04-20ee6d993654 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:26:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:26:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:26:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:26:49 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:26:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f07ba0ca-0e81-45b5-ac04-20ee6d993654 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:49 devstack sudo[85067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f07ba0ca-0e81-45b5-ac04-20ee6d993654 1073741824 Apr 16 13:26:49 devstack sudo[85067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:49 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-70e237eb-7707-497d-8499-94cf8340a5c4 tempest-GroupSnapshotsTest-1532467286 None] Create group from source-snapshot-eb06fa7b-388c-42a7-b92a-fb754f7246fc completed successfully. Apr 16 13:26:50 devstack sudo[85067]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f07ba0ca-0e81-45b5-ac04-20ee6d993654 1073741824" returned: 0 in 0.706s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f07ba0ca-0e81-45b5-ac04-20ee6d993654 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:50 devstack sudo[85074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f07ba0ca-0e81-45b5-ac04-20ee6d993654 Apr 16 13:26:50 devstack sudo[85074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "cinder-quobyte-fe6127c7-1e60-42d4-a2b0-f9e2844ab183" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:26:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-fe6127c7-1e60-42d4-a2b0-f9e2844ab183" acquired by "delete_volume" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:26:50 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fac448-14ba-48d6-9bd5-0580ddfb10a4]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:26:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-fe6127c7-1e60-42d4-a2b0-f9e2844ab183 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:50 devstack sudo[85076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-fe6127c7-1e60-42d4-a2b0-f9e2844ab183 Apr 16 13:26:50 devstack sudo[85076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:51 devstack sudo[85074]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f07ba0ca-0e81-45b5-ac04-20ee6d993654" returned: 0 in 0.525s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cd5eba-5842-4532-a880-7d3703cb02ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f07ba0ca-0e81-45b5-ac04-20ee6d993654', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2956d7a5-1612-4aa7-ae26-8da3c2e8a7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:51 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Volume volume-f07ba0ca-0e81-45b5-ac04-20ee6d993654 (f07ba0ca-0e81-45b5-ac04-20ee6d993654): created successfully Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2956d7a5-1612-4aa7-ae26-8da3c2e8a7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Flow 'volume_create_manager' (81842cd5-33cf-4dd7-ae26-ff034692dc84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:26:51 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-182ae69a-14e4-48ba-88f3-be77a678bf2d tempest-ServersNegativeTestJSON-1401050407 None] Created volume successfully. Apr 16 13:26:51 devstack cinder-volume[83606]: INFO cinder.volume.manager [req-69dee19e-7cbc-40f2-b6cf-f0572974dd18 req-bcb0f60e-900d-419b-bdf0-bcf7fa86d647 tempest-DeleteServersTestJSON-1519581918 None] Terminate volume connection completed successfully. Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-69dee19e-7cbc-40f2-b6cf-f0572974dd18 req-bcb0f60e-900d-419b-bdf0-bcf7fa86d647 tempest-DeleteServersTestJSON-1519581918 None] Deleting attachment 99ed7483-2714-4d8e-ab60-be3358df01dc. {{(pid=83606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 13:26:51 devstack sudo[85076]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-fe6127c7-1e60-42d4-a2b0-f9e2844ab183" returned: 0 in 0.634s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-fe6127c7-1e60-42d4-a2b0-f9e2844ab183 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:51 devstack sudo[85083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-fe6127c7-1e60-42d4-a2b0-f9e2844ab183 Apr 16 13:26:51 devstack sudo[85083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:51 devstack sudo[85083]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-fe6127c7-1e60-42d4-a2b0-f9e2844ab183" returned: 0 in 0.417s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-fe6127c7-1e60-42d4-a2b0-f9e2844ab183" released by "delete_volume" :: held 1.085s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] Created reservations ['be1e581f-93ce-49ba-afcd-7fd97be6d42d'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:26:51 devstack cinder-volume[83606]: WARNING cinder.quota [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1054503851 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1054503851, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:26:51 devstack cinder-volume[83606]: WARNING cinder.quota [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1054503851 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1054503851, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] Created reservations ['24c8ae1d-9aef-4597-a93d-55bf8165bf60', '0f7ddb9a-3bf8-4d32-b775-fb696e910dc9', '3c2e894c-3443-4e8a-8f4c-5988dc579403', '78d28a01-6e0b-4ed5-9489-d57839cd6d41'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:51 devstack sudo[85087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:26:51 devstack sudo[85087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:52 devstack sudo[85087]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.455s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:26:52 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-af3b7569-7ec0-45d1-9e13-a0fba5ebdcec tempest-GroupSnapshotsTest-1532467286 None] Delete group completed successfully. Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Flow 'volume_create_manager' (72be64f3-783e-400c-9a34-343f2a61f3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6426c9-9a76-4576-8307-69218c84054d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6426c9-9a76-4576-8307-69218c84054d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-278086196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d8f953-0812-44d2-ba94-d2c0671fdf47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca44568fdbd044848f9d34f23744dfdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:26:53Z,use_quota=True,user_id='7e4ab0865cee4ea2b18ae5c03e3deb16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1e61b1-6d90-4932-9884-9e11ccbf23f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1e61b1-6d90-4932-9884-9e11ccbf23f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2088feb4-a14a-4c4a-b00f-007e1d83f546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2088feb4-a14a-4c4a-b00f-007e1d83f546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32d8f953-0812-44d2-ba94-d2c0671fdf47', 'volume_name': 'volume-32d8f953-0812-44d2-ba94-d2c0671fdf47', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7aa6d3d-a2b3-4bfb-b6db-a8cea7beab67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7aa6d3d-a2b3-4bfb-b6db-a8cea7beab67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b25811-b748-4bc4-a5c9-7df5eba6f36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:52 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Volume 32d8f953-0812-44d2-ba94-d2c0671fdf47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32d8f953-0812-44d2-ba94-d2c0671fdf47', 'volume_size': 1} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-278086196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d8f953-0812-44d2-ba94-d2c0671fdf47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca44568fdbd044848f9d34f23744dfdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:26:53Z,use_quota=True,user_id='7e4ab0865cee4ea2b18ae5c03e3deb16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Creating volume 32d8f953-0812-44d2-ba94-d2c0671fdf47 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:26:52 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-32d8f953-0812-44d2-ba94-d2c0671fdf47 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:52 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] group_snapshot eb06fa7b-388c-42a7-b92a-fb754f7246fc: deleting Apr 16 13:26:52 devstack sudo[85090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-32d8f953-0812-44d2-ba94-d2c0671fdf47 1073741824 Apr 16 13:26:52 devstack sudo[85090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] group_snapshot eb06fa7b-388c-42a7-b92a-fb754f7246fc: deleting {{(pid=83606) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "cinder-quobyte-678b2d63-a905-4613-9a03-b7c4e340d20e" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-678b2d63-a905-4613-9a03-b7c4e340d20e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "cinder-quobyte-c4d7f127-2575-4479-9774-ba19c413885a" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-c4d7f127-2575-4479-9774-ba19c413885a" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:26:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] Deleting offline snapshot c4d7f127-2575-4479-9774-ba19c413885a of volume 678b2d63-a905-4613-9a03-b7c4e340d20e {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:26:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] snapshot_file for this snap is: volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:26:53 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1ca551-cc98-4ae7-ac1c-558cfdab8b49]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:26:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:53 devstack sudo[85092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a Apr 16 13:26:53 devstack sudo[85092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:53 devstack sudo[85090]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-32d8f953-0812-44d2-ba94-d2c0671fdf47 1073741824" returned: 0 in 0.603s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-32d8f953-0812-44d2-ba94-d2c0671fdf47 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:53 devstack sudo[85101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-32d8f953-0812-44d2-ba94-d2c0671fdf47 Apr 16 13:26:53 devstack sudo[85101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:53 devstack sudo[85092]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a" returned: 0 in 0.587s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-678b2d63-a905-4613-9a03-b7c4e340d20e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:26:53 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c65109-7e3c-4224-beb6-d4d9dd75e51f]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:26:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:53 devstack sudo[85104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e Apr 16 13:26:53 devstack sudo[85104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:54 devstack sudo[85101]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-32d8f953-0812-44d2-ba94-d2c0671fdf47" returned: 0 in 0.500s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:54 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:26:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b25811-b748-4bc4-a5c9-7df5eba6f36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d8f953-0812-44d2-ba94-d2c0671fdf47', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e120a6-d7eb-425d-8afe-1da1b2a45860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:54 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Volume volume-32d8f953-0812-44d2-ba94-d2c0671fdf47 (32d8f953-0812-44d2-ba94-d2c0671fdf47): created successfully Apr 16 13:26:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e120a6-d7eb-425d-8afe-1da1b2a45860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Flow 'volume_create_manager' (72be64f3-783e-400c-9a34-343f2a61f3ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:26:54 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-5e9f587e-9372-4128-81b4-60fd9a1c4824 tempest-ServersNegativeTestJSON-1401050407 None] Created volume successfully. Apr 16 13:26:54 devstack sudo[85104]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e" returned: 0 in 0.604s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:54 devstack sudo[85110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a Apr 16 13:26:54 devstack sudo[85110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] Acquiring lock "cinder-f98fa551-5b30-4a5c-bba2-27607bc8f1fa-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:26:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] Lock "cinder-f98fa551-5b30-4a5c-bba2-27607bc8f1fa-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:26:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] Acquiring lock "cinder-quobyte-f98fa551-5b30-4a5c-bba2-27607bc8f1fa" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:26:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] Lock "cinder-quobyte-f98fa551-5b30-4a5c-bba2-27607bc8f1fa" acquired by "delete_volume" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:26:54 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[31579a29-ab2e-4fc5-afa5-993d4af3ab88]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:26:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:54 devstack sudo[85112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa Apr 16 13:26:54 devstack sudo[85112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:54 devstack sudo[85110]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a" returned: 0 in 0.560s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:54 devstack sudo[85117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a Apr 16 13:26:54 devstack sudo[85117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:55 devstack sudo[85112]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa" returned: 0 in 0.649s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:55 devstack sudo[85122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa Apr 16 13:26:55 devstack sudo[85122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] Acquiring lock "cinder-32d8f953-0812-44d2-ba94-d2c0671fdf47-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] Lock "cinder-32d8f953-0812-44d2-ba94-d2c0671fdf47-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] Acquiring lock "cinder-quobyte-32d8f953-0812-44d2-ba94-d2c0671fdf47" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] Lock "cinder-quobyte-32d8f953-0812-44d2-ba94-d2c0671fdf47" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0552f04f-50be-4887-af5d-ece996dc683a]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-32d8f953-0812-44d2-ba94-d2c0671fdf47 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:55 devstack sudo[85117]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e.c4d7f127-2575-4479-9774-ba19c413885a" returned: 0 in 0.572s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-c4d7f127-2575-4479-9774-ba19c413885a" released by "_delete_snapshot" :: held 2.385s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-678b2d63-a905-4613-9a03-b7c4e340d20e" released by "delete_snapshot" :: held 2.411s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:26:55 devstack sudo[85125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-32d8f953-0812-44d2-ba94-d2c0671fdf47 Apr 16 13:26:55 devstack sudo[85125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:55 devstack cinder-volume[83606]: WARNING cinder.quota [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1054503851 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1054503851, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] Created reservations ['7b78d60e-823b-4930-80f2-b77d911f4734', 'd916fd02-d385-4b5e-9ec2-9582de612ae8', '30878cce-472a-4eea-8dc0-bc4ff0f6190e', '21c9a2ee-608e-4338-8733-b017cfef3341'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:26:55 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-ee389001-3737-4b40-a69c-86c86173b1bc tempest-GroupSnapshotsTest-1532467286 None] group_snapshot eb06fa7b-388c-42a7-b92a-fb754f7246fc: deleted successfully Apr 16 13:26:55 devstack sudo[85122]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f98fa551-5b30-4a5c-bba2-27607bc8f1fa" returned: 0 in 0.571s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] Lock "cinder-quobyte-f98fa551-5b30-4a5c-bba2-27607bc8f1fa" released by "delete_volume" :: held 1.252s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] Created reservations ['24ffbb1b-c013-4a50-aebb-6d7ad8e45610', 'f6c944be-7600-4ab5-943b-266372f9eb17', 'de1e9ddc-6f47-4968-a23e-399cbffa3194', 'eed2dd26-c7f4-4bed-a67c-9b4c7f035de7'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:55 devstack sudo[85128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:26:55 devstack sudo[85128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:55 devstack sudo[85125]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-32d8f953-0812-44d2-ba94-d2c0671fdf47" returned: 0 in 0.612s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-32d8f953-0812-44d2-ba94-d2c0671fdf47 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:55 devstack sudo[85133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-32d8f953-0812-44d2-ba94-d2c0671fdf47 Apr 16 13:26:55 devstack sudo[85133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:56 devstack sudo[85128]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.522s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:56 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:26:56 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] Deleted volume successfully. Apr 16 13:26:56 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-567322e5-deaf-4942-927b-5e4a6b5da1db tempest-DeleteServersTestJSON-1519581918 None] Lock "cinder-f98fa551-5b30-4a5c-bba2-27607bc8f1fa-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:26:56 devstack sudo[85133]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-32d8f953-0812-44d2-ba94-d2c0671fdf47" returned: 0 in 0.585s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:56 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] Lock "cinder-quobyte-32d8f953-0812-44d2-ba94-d2c0671fdf47" released by "delete_volume" :: held 1.217s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:26:56 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] Created reservations ['82e08448-bf8b-40ee-8796-6cf53b4cb864', '6d2562a8-c53b-44f3-b246-2840edab62f0', '8b38b164-2c3e-40b6-8f31-6b007c244a1f', '06563b26-e4b8-43e8-beb2-c9e123ba374d'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:26:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:56 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:26:56 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:26:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:56 devstack sudo[85143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:26:56 devstack sudo[85143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:56 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "cinder-quobyte-678b2d63-a905-4613-9a03-b7c4e340d20e" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:26:56 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-678b2d63-a905-4613-9a03-b7c4e340d20e" acquired by "delete_volume" :: waited 0.029s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:26:56 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b5db97-9c61-4886-a3c7-eb40c6a3ce57]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:26:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:56 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:26:56 devstack sudo[85145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e Apr 16 13:26:57 devstack sudo[85145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Flow 'volume_create_manager' (97558ca9-5721-4ad2-b0fc-7bb738b204fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e355e0-c844-468e-9464-4a7daf2b6c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e355e0-c844-468e-9464-4a7daf2b6c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1380044997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f1c4d0-a2af-4418-9d3b-9d83e21cf052,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75d59fff47bd4dc28129d9fcb6674f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:26:57Z,use_quota=True,user_id='8286bf3beb07432893df21d5cdca1d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339aedcc-117e-4a24-a5af-f1ddfce28088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339aedcc-117e-4a24-a5af-f1ddfce28088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd36d81-68eb-406e-8aa7-c1450b3fb7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd36d81-68eb-406e-8aa7-c1450b3fb7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f1c4d0-a2af-4418-9d3b-9d83e21cf052', 'volume_name': 'volume-49f1c4d0-a2af-4418-9d3b-9d83e21cf052', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c2be36-21de-45ea-bacc-ab9c4dd94403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c2be36-21de-45ea-bacc-ab9c4dd94403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2919845c-a958-400a-ac8e-846195f77c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:57 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Volume 49f1c4d0-a2af-4418-9d3b-9d83e21cf052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f1c4d0-a2af-4418-9d3b-9d83e21cf052', 'volume_size': 1} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1380044997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f1c4d0-a2af-4418-9d3b-9d83e21cf052,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75d59fff47bd4dc28129d9fcb6674f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:26:57Z,use_quota=True,user_id='8286bf3beb07432893df21d5cdca1d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Creating volume 49f1c4d0-a2af-4418-9d3b-9d83e21cf052 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:26:57 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-49f1c4d0-a2af-4418-9d3b-9d83e21cf052 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:57 devstack sudo[85147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-49f1c4d0-a2af-4418-9d3b-9d83e21cf052 1073741824 Apr 16 13:26:57 devstack sudo[85147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:57 devstack sudo[85143]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.668s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:26:57 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] Deleted volume successfully. Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e301b52d-eaf5-403a-9063-e42b2a5786a5 tempest-ServersNegativeTestJSON-1401050407 None] Lock "cinder-32d8f953-0812-44d2-ba94-d2c0671fdf47-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:26:57 devstack sudo[85145]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e" returned: 0 in 0.554s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:57 devstack sudo[85154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e Apr 16 13:26:57 devstack sudo[85154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] Acquiring lock "cinder-f07ba0ca-0e81-45b5-ac04-20ee6d993654-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] Lock "cinder-f07ba0ca-0e81-45b5-ac04-20ee6d993654-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] Acquiring lock "cinder-quobyte-f07ba0ca-0e81-45b5-ac04-20ee6d993654" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] Lock "cinder-quobyte-f07ba0ca-0e81-45b5-ac04-20ee6d993654" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed64ee3-0592-4a3a-a9cc-d1ed705089ac]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f07ba0ca-0e81-45b5-ac04-20ee6d993654 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:57 devstack sudo[85158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f07ba0ca-0e81-45b5-ac04-20ee6d993654 Apr 16 13:26:57 devstack sudo[85158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:57 devstack sudo[85147]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-49f1c4d0-a2af-4418-9d3b-9d83e21cf052 1073741824" returned: 0 in 0.612s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-49f1c4d0-a2af-4418-9d3b-9d83e21cf052 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:57 devstack sudo[85160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-49f1c4d0-a2af-4418-9d3b-9d83e21cf052 Apr 16 13:26:57 devstack sudo[85160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:57 devstack sudo[85154]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-678b2d63-a905-4613-9a03-b7c4e340d20e" returned: 0 in 0.549s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-678b2d63-a905-4613-9a03-b7c4e340d20e" released by "delete_volume" :: held 1.174s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] Created reservations ['51854837-d98b-4c83-8f4c-4f9c20912100'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:26:58 devstack cinder-volume[83606]: WARNING cinder.db.sqlalchemy.api [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1054503851'] Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] Created reservations ['4beb4156-649b-4f6d-8e03-6009a285c3cb', '3fadbe45-05cc-41c8-a580-18721dae0616', '5058a06c-8472-4efb-84ea-8d9f3e62749c', '450f4b58-ecb4-4e35-b4f8-acc74c51bcea'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:26:58 devstack sudo[85158]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f07ba0ca-0e81-45b5-ac04-20ee6d993654" returned: 0 in 0.574s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f07ba0ca-0e81-45b5-ac04-20ee6d993654 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:58 devstack sudo[85167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f07ba0ca-0e81-45b5-ac04-20ee6d993654 Apr 16 13:26:58 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:58 devstack sudo[85170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:26:58 devstack sudo[85170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:58 devstack sudo[85160]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-49f1c4d0-a2af-4418-9d3b-9d83e21cf052" returned: 0 in 0.563s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2919845c-a958-400a-ac8e-846195f77c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f1c4d0-a2af-4418-9d3b-9d83e21cf052', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a40723-54d0-45a4-af30-f568d140cd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:58 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Volume volume-49f1c4d0-a2af-4418-9d3b-9d83e21cf052 (49f1c4d0-a2af-4418-9d3b-9d83e21cf052): created successfully Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a40723-54d0-45a4-af30-f568d140cd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Flow 'volume_create_manager' (97558ca9-5721-4ad2-b0fc-7bb738b204fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:26:58 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-822fed4d-cb2a-4df4-bbf2-8fcd831690e4 tempest-VolumesTestJSON-2017820125 None] Created volume successfully. Apr 16 13:26:58 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f07ba0ca-0e81-45b5-ac04-20ee6d993654" returned: 0 in 0.459s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] Lock "cinder-quobyte-f07ba0ca-0e81-45b5-ac04-20ee6d993654" released by "delete_volume" :: held 1.065s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] Created reservations ['ee1c0b28-1a20-40a0-a9e2-aa0721f9d9ea', 'a3bc9f25-f00b-4b80-aa9c-fa33bb0db430', 'c12ab7ef-2399-4d21-a1f6-7405c9b7444d', '6586ddb4-a45e-42da-840b-2fec63ef6dc3'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:58 devstack sudo[85173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:26:58 devstack sudo[85173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:26:58 devstack sudo[85170]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.580s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:58 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:26:58 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-5a30b892-99f8-456d-8ba2-ef14f634db06 tempest-GroupSnapshotsTest-1532467286 None] Delete group completed successfully. Apr 16 13:26:59 devstack sudo[85173]: pam_unix(sudo:session): session closed for user root Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.532s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:26:59 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] Deleted volume successfully. Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7e90f7b9-9ac1-4be1-987c-ffc6ce78ee30 tempest-ServersNegativeTestJSON-1401050407 None] Lock "cinder-f07ba0ca-0e81-45b5-ac04-20ee6d993654-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:26:59 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-46105bfd-6c40-4f8a-b3ae-673313d6d56e tempest-GroupSnapshotsTest-1532467286 None] Group tempest-GroupSnapshotsTest-Group-343273578: creating Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Flow 'volume_create_manager' (2f8efbaf-dbd9-415a-9275-894108c552b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7561fca1-3424-4743-9421-93e42239a60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:59 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-46105bfd-6c40-4f8a-b3ae-673313d6d56e tempest-GroupSnapshotsTest-1532467286 None] Group tempest-GroupSnapshotsTest-Group-343273578: created successfully Apr 16 13:26:59 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-46105bfd-6c40-4f8a-b3ae-673313d6d56e tempest-GroupSnapshotsTest-1532467286 None] Create group completed successfully. Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7561fca1-3424-4743-9421-93e42239a60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1356285844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74de10e-6a63-4603-b783-d6dc9b3ffa16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75d59fff47bd4dc28129d9fcb6674f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:26:59Z,use_quota=True,user_id='8286bf3beb07432893df21d5cdca1d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6596b0-d2f1-4e91-81dd-152dc4020761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6596b0-d2f1-4e91-81dd-152dc4020761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ece6f2-5c2c-4776-ab5e-e124e9b0e2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ece6f2-5c2c-4776-ab5e-e124e9b0e2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c74de10e-6a63-4603-b783-d6dc9b3ffa16', 'volume_name': 'volume-c74de10e-6a63-4603-b783-d6dc9b3ffa16', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ef08a6-6a2b-4d73-961e-a61fa334c40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ef08a6-6a2b-4d73-961e-a61fa334c40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac82b7a-0b38-4805-92bd-159dbf8fe487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:26:59 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Volume c74de10e-6a63-4603-b783-d6dc9b3ffa16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c74de10e-6a63-4603-b783-d6dc9b3ffa16', 'volume_size': 1} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1356285844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74de10e-6a63-4603-b783-d6dc9b3ffa16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75d59fff47bd4dc28129d9fcb6674f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:26:59Z,use_quota=True,user_id='8286bf3beb07432893df21d5cdca1d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Creating volume c74de10e-6a63-4603-b783-d6dc9b3ffa16 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:26:59 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:26:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c74de10e-6a63-4603-b783-d6dc9b3ffa16 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:26:59 devstack sudo[85178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c74de10e-6a63-4603-b783-d6dc9b3ffa16 1073741824 Apr 16 13:26:59 devstack sudo[85178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:00 devstack sudo[85178]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c74de10e-6a63-4603-b783-d6dc9b3ffa16 1073741824" returned: 0 in 0.618s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c74de10e-6a63-4603-b783-d6dc9b3ffa16 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:00 devstack sudo[85184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c74de10e-6a63-4603-b783-d6dc9b3ffa16 Apr 16 13:27:00 devstack sudo[85184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:00 devstack sudo[85184]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c74de10e-6a63-4603-b783-d6dc9b3ffa16" returned: 0 in 0.493s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac82b7a-0b38-4805-92bd-159dbf8fe487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c74de10e-6a63-4603-b783-d6dc9b3ffa16', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e452d39-2cbd-4db7-9aaf-1484a426b6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:00 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Volume volume-c74de10e-6a63-4603-b783-d6dc9b3ffa16 (c74de10e-6a63-4603-b783-d6dc9b3ffa16): created successfully Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e452d39-2cbd-4db7-9aaf-1484a426b6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Flow 'volume_create_manager' (2f8efbaf-dbd9-415a-9275-894108c552b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:00 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-03ff7197-b2ce-45e6-b1d1-1114a017f5ad tempest-VolumesTestJSON-2017820125 None] Created volume successfully. Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Flow 'volume_create_manager' (d96f54fa-c750-43c9-a66f-34663052e18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c2b6bb-ea62-4dcb-b6cf-31974493c37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c2b6bb-ea62-4dcb-b6cf-31974493c37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1953082982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c470135-1b28-4667-a8ee-3eb8af62338f,host='devstack@QuobyteHD#QuobyteHD',id=66b72ef9-662c-46a2-9abb-7fcfe188c4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085ce34bb5314c07a4039dd1006aa8de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:01Z,use_quota=True,user_id='3cd2135733444c01be9145f2e00c61fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4eda073a-d529-4cb2-b829-06c29396455d),volume_type_id=4eda073a-d529-4cb2-b829-06c29396455d)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5e7359-1c46-4df4-9eda-200d4ce069d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5e7359-1c46-4df4-9eda-200d4ce069d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a176ce65-4a02-4fd5-9f8b-4e898c207eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a176ce65-4a02-4fd5-9f8b-4e898c207eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b72ef9-662c-46a2-9abb-7fcfe188c4f8', 'volume_name': 'volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9439b1f2-f060-4dd5-9df6-4f8e67dc56fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9439b1f2-f060-4dd5-9df6-4f8e67dc56fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20fa4488-fab8-4ae0-a694-c0932839f93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:00 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Volume 66b72ef9-662c-46a2-9abb-7fcfe188c4f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8', 'volume_size': 1} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c470135-1b28-4667-a8ee-3eb8af62338f,created_at=2026-04-16T11:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1953082982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c470135-1b28-4667-a8ee-3eb8af62338f,host='devstack@QuobyteHD#QuobyteHD',id=66b72ef9-662c-46a2-9abb-7fcfe188c4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085ce34bb5314c07a4039dd1006aa8de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:01Z,use_quota=True,user_id='3cd2135733444c01be9145f2e00c61fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4eda073a-d529-4cb2-b829-06c29396455d),volume_type_id=4eda073a-d529-4cb2-b829-06c29396455d)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Creating volume 66b72ef9-662c-46a2-9abb-7fcfe188c4f8 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:27:00 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:27:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:00 devstack sudo[85229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8 1073741824 Apr 16 13:27:00 devstack sudo[85229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:01 devstack sudo[85229]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8 1073741824" returned: 0 in 0.652s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:01 devstack sudo[85249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8 Apr 16 13:27:01 devstack sudo[85249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:01 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Flow 'volume_create_manager' (8caa3d49-720c-4899-ad1d-df29ed4f5642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a738505b-d913-463a-baaf-11137453e603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a738505b-d913-463a-baaf-11137453e603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1330155799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2330e1b6-50cd-4c30-bcc5-969ba7844785,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75d59fff47bd4dc28129d9fcb6674f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:02Z,use_quota=True,user_id='8286bf3beb07432893df21d5cdca1d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3578d16-f0ac-4201-b218-3eb4d3bd5b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3578d16-f0ac-4201-b218-3eb4d3bd5b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba061526-1864-45b4-964d-f242935d35f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba061526-1864-45b4-964d-f242935d35f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2330e1b6-50cd-4c30-bcc5-969ba7844785', 'volume_name': 'volume-2330e1b6-50cd-4c30-bcc5-969ba7844785', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e487b0a-9037-4599-ad9f-16abe61c6d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e487b0a-9037-4599-ad9f-16abe61c6d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2015ac4-b867-4b4c-97ac-04e9c47e866d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:02 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Volume 2330e1b6-50cd-4c30-bcc5-969ba7844785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2330e1b6-50cd-4c30-bcc5-969ba7844785', 'volume_size': 1} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:02 devstack sudo[85249]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8" returned: 0 in 0.704s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.216s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1330155799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2330e1b6-50cd-4c30-bcc5-969ba7844785,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75d59fff47bd4dc28129d9fcb6674f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:02Z,use_quota=True,user_id='8286bf3beb07432893df21d5cdca1d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Creating volume 2330e1b6-50cd-4c30-bcc5-969ba7844785 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:27:02 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2330e1b6-50cd-4c30-bcc5-969ba7844785 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20fa4488-fab8-4ae0-a694-c0932839f93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ee065b-8b5f-4439-b51c-0828e744e2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:02 devstack sudo[85255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2330e1b6-50cd-4c30-bcc5-969ba7844785 1073741824 Apr 16 13:27:02 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:02 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Volume volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8 (66b72ef9-662c-46a2-9abb-7fcfe188c4f8): created successfully Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ee065b-8b5f-4439-b51c-0828e744e2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Flow 'volume_create_manager' (d96f54fa-c750-43c9-a66f-34663052e18e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:02 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-24058b57-b7da-40a4-a727-048f44c7c232 tempest-GroupSnapshotsTest-1532467286 None] Created volume successfully. Apr 16 13:27:03 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2330e1b6-50cd-4c30-bcc5-969ba7844785 1073741824" returned: 0 in 0.650s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2330e1b6-50cd-4c30-bcc5-969ba7844785 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:03 devstack sudo[85264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2330e1b6-50cd-4c30-bcc5-969ba7844785 Apr 16 13:27:03 devstack sudo[85264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Flow 'volume_create_manager' (5d366af7-79ac-4aca-b909-6bf04207d05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55be6f53-2562-468c-999b-8241f0173efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55be6f53-2562-468c-999b-8241f0173efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1803622326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c470135-1b28-4667-a8ee-3eb8af62338f,host='devstack@QuobyteHD#QuobyteHD',id=df93440f-93a5-4426-adca-d09fe5a787c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085ce34bb5314c07a4039dd1006aa8de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:03Z,use_quota=True,user_id='3cd2135733444c01be9145f2e00c61fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4eda073a-d529-4cb2-b829-06c29396455d),volume_type_id=4eda073a-d529-4cb2-b829-06c29396455d)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e92fcca8-82a8-4ec0-a33c-2ac73eb0b3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:03 devstack sudo[85264]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e92fcca8-82a8-4ec0-a33c-2ac73eb0b3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9c52cb-1231-4b3a-b022-05b88c47f65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9c52cb-1231-4b3a-b022-05b88c47f65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df93440f-93a5-4426-adca-d09fe5a787c4', 'volume_name': 'volume-df93440f-93a5-4426-adca-d09fe5a787c4', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df21ddb-bcb8-4cef-ba51-83ad26901f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df21ddb-bcb8-4cef-ba51-83ad26901f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da59f10f-8897-4aab-ac99-5d2d5cb7a7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:03 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Volume df93440f-93a5-4426-adca-d09fe5a787c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df93440f-93a5-4426-adca-d09fe5a787c4', 'volume_size': 1} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2330e1b6-50cd-4c30-bcc5-969ba7844785" returned: 0 in 0.549s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c470135-1b28-4667-a8ee-3eb8af62338f,created_at=2026-04-16T11:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1803622326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c470135-1b28-4667-a8ee-3eb8af62338f,host='devstack@QuobyteHD#QuobyteHD',id=df93440f-93a5-4426-adca-d09fe5a787c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085ce34bb5314c07a4039dd1006aa8de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:03Z,use_quota=True,user_id='3cd2135733444c01be9145f2e00c61fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4eda073a-d529-4cb2-b829-06c29396455d),volume_type_id=4eda073a-d529-4cb2-b829-06c29396455d)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Creating volume df93440f-93a5-4426-adca-d09fe5a787c4 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:27:03 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2015ac4-b867-4b4c-97ac-04e9c47e866d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2330e1b6-50cd-4c30-bcc5-969ba7844785', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57eff067-37de-402e-94f8-9bde023a121b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:03 devstack sudo[85268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4 1073741824 Apr 16 13:27:03 devstack sudo[85268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:03 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Volume volume-2330e1b6-50cd-4c30-bcc5-969ba7844785 (2330e1b6-50cd-4c30-bcc5-969ba7844785): created successfully Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57eff067-37de-402e-94f8-9bde023a121b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Flow 'volume_create_manager' (8caa3d49-720c-4899-ad1d-df29ed4f5642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:03 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-48895655-29f0-4288-9cbb-7ec841df9d55 tempest-VolumesTestJSON-2017820125 None] Created volume successfully. Apr 16 13:27:04 devstack sudo[85268]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4 1073741824" returned: 0 in 0.523s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:04 devstack sudo[85273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4 Apr 16 13:27:04 devstack sudo[85273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:04 devstack sudo[85273]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4" returned: 0 in 0.541s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:04 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:27:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:04 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da59f10f-8897-4aab-ac99-5d2d5cb7a7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df93440f-93a5-4426-adca-d09fe5a787c4', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:04 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4dcacf-d636-4f65-8d2e-ca9309c4e954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:04 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Volume volume-df93440f-93a5-4426-adca-d09fe5a787c4 (df93440f-93a5-4426-adca-d09fe5a787c4): created successfully Apr 16 13:27:04 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4dcacf-d636-4f65-8d2e-ca9309c4e954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:04 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Flow 'volume_create_manager' (5d366af7-79ac-4aca-b909-6bf04207d05f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:04 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-dea568d8-2fc9-46a8-81af-1529c77201e3 tempest-GroupSnapshotsTest-1532467286 None] Created volume successfully. Apr 16 13:27:04 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] Acquiring lock "cinder-2330e1b6-50cd-4c30-bcc5-969ba7844785-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:04 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] Lock "cinder-2330e1b6-50cd-4c30-bcc5-969ba7844785-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:04 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] Acquiring lock "cinder-quobyte-2330e1b6-50cd-4c30-bcc5-969ba7844785" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:04 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] Lock "cinder-quobyte-2330e1b6-50cd-4c30-bcc5-969ba7844785" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:04 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dbd936-08cc-4979-82b8-8ed125d04300]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2330e1b6-50cd-4c30-bcc5-969ba7844785 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:05 devstack sudo[85276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2330e1b6-50cd-4c30-bcc5-969ba7844785 Apr 16 13:27:05 devstack sudo[85276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:05 devstack sudo[85276]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2330e1b6-50cd-4c30-bcc5-969ba7844785" returned: 0 in 0.598s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2330e1b6-50cd-4c30-bcc5-969ba7844785 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:05 devstack sudo[85281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2330e1b6-50cd-4c30-bcc5-969ba7844785 Apr 16 13:27:05 devstack sudo[85281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:05 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-8803ec12-3f3c-49f8-9ec0-f78a1a85600a tempest-GroupSnapshotsTest-1532467286 None] Update group completed successfully. Apr 16 13:27:06 devstack sudo[85281]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2330e1b6-50cd-4c30-bcc5-969ba7844785" returned: 0 in 0.537s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] Lock "cinder-quobyte-2330e1b6-50cd-4c30-bcc5-969ba7844785" released by "delete_volume" :: held 1.170s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:06 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] Created reservations ['f2272cdf-b234-4731-a6ee-f363d11d2cfb', '883e9680-3185-4d69-a661-bacd975562fe', '81d186f0-86a2-48b1-940e-854dd407473d', '95dc3bac-4d22-483a-94e0-6bbdd9c9a5eb'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:06 devstack sudo[85284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:27:06 devstack sudo[85284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:06 devstack sudo[85284]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.505s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:06 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:27:06 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] Deleted volume successfully. Apr 16 13:27:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-2058e805-670b-4cc5-965a-8c7b0106c5c7 tempest-VolumesTestJSON-2017820125 None] Lock "cinder-2330e1b6-50cd-4c30-bcc5-969ba7844785-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:06 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-272449ea-17d1-4ae0-b638-9e02bbe9da55 tempest-GroupSnapshotsTest-1532467286 None] Update group completed successfully. Apr 16 13:27:07 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] Acquiring lock "cinder-c74de10e-6a63-4603-b783-d6dc9b3ffa16-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:07 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] Lock "cinder-c74de10e-6a63-4603-b783-d6dc9b3ffa16-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:07 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] Acquiring lock "cinder-quobyte-c74de10e-6a63-4603-b783-d6dc9b3ffa16" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:07 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] Lock "cinder-quobyte-c74de10e-6a63-4603-b783-d6dc9b3ffa16" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:07 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b9ebfc-fb8a-43ec-a9bf-48af7ac04b29]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c74de10e-6a63-4603-b783-d6dc9b3ffa16 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:07 devstack sudo[85287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c74de10e-6a63-4603-b783-d6dc9b3ffa16 Apr 16 13:27:07 devstack sudo[85287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:07 devstack sudo[85287]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c74de10e-6a63-4603-b783-d6dc9b3ffa16" returned: 0 in 0.708s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c74de10e-6a63-4603-b783-d6dc9b3ffa16 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:07 devstack sudo[85292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c74de10e-6a63-4603-b783-d6dc9b3ffa16 Apr 16 13:27:07 devstack sudo[85292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:08 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-8c17d8ef-de2d-4d18-b875-fd14c7ecedde tempest-GroupSnapshotsTest-1532467286 None] Update group completed successfully. Apr 16 13:27:08 devstack sudo[85292]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c74de10e-6a63-4603-b783-d6dc9b3ffa16" returned: 0 in 0.586s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] Lock "cinder-quobyte-c74de10e-6a63-4603-b783-d6dc9b3ffa16" released by "delete_volume" :: held 1.321s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:08 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] Created reservations ['f63f5c68-be45-45c0-9dbc-5dc9ee03068b', '1761ffdb-a527-4242-a961-6c412269b271', 'c5c85fbf-b31d-4c6e-a0bd-3463eca2487b', 'ca45fbe6-4da5-4cc4-a536-2a9b897db302'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:08 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:08 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:08 devstack sudo[85295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:27:08 devstack sudo[85295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:09 devstack sudo[85295]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.629s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:09 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:27:09 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] Deleted volume successfully. Apr 16 13:27:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-921ef9ab-04b0-4b11-a716-b5ce4afca03d tempest-VolumesTestJSON-2017820125 None] Lock "cinder-c74de10e-6a63-4603-b783-d6dc9b3ffa16-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:09 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-3658378a-0d06-4fdf-8e07-4c9258d1460f tempest-GroupSnapshotsTest-1532467286 None] Update group completed successfully. Apr 16 13:27:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] Acquiring lock "cinder-49f1c4d0-a2af-4418-9d3b-9d83e21cf052-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] Lock "cinder-49f1c4d0-a2af-4418-9d3b-9d83e21cf052-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] Acquiring lock "cinder-quobyte-49f1c4d0-a2af-4418-9d3b-9d83e21cf052" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] Lock "cinder-quobyte-49f1c4d0-a2af-4418-9d3b-9d83e21cf052" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:09 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5cdc51-70a1-4576-b837-6465242e9963]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-49f1c4d0-a2af-4418-9d3b-9d83e21cf052 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:09 devstack sudo[85299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-49f1c4d0-a2af-4418-9d3b-9d83e21cf052 Apr 16 13:27:09 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:10 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-49f1c4d0-a2af-4418-9d3b-9d83e21cf052" returned: 0 in 0.585s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-49f1c4d0-a2af-4418-9d3b-9d83e21cf052 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:10 devstack sudo[85304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-49f1c4d0-a2af-4418-9d3b-9d83e21cf052 Apr 16 13:27:10 devstack sudo[85304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:10 devstack sudo[85304]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-49f1c4d0-a2af-4418-9d3b-9d83e21cf052" returned: 0 in 0.539s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:10 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] Lock "cinder-quobyte-49f1c4d0-a2af-4418-9d3b-9d83e21cf052" released by "delete_volume" :: held 1.160s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:10 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] Created reservations ['efeffb3b-d14f-47a5-961d-3e2ad6b9724d', '7a21ddcf-5d03-4b71-b13e-dce3d9bf2984', '1bfa3d4f-2c03-4342-9060-9cd5c27103f5', 'cf2b44fc-70c6-4789-acb6-914a90f6db2b'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:10 devstack sudo[85310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:27:10 devstack sudo[85310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:10 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] GroupSnapshot 1a46dbdc-bdbd-4244-81bf-0743224c32fc: creating. Apr 16 13:27:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Group snapshot 1a46dbdc-bdbd-4244-81bf-0743224c32fc: creating. {{(pid=83606) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 13:27:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Creating offline snapshot 10bb6937-61fe-4214-87e0-91d7ff0f6fa0 of volume 66b72ef9-662c-46a2-9abb-7fcfe188c4f8 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:27:10 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[71719037-91b5-4889-941a-845ee0a7ca7c]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:10 devstack sudo[85312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8 Apr 16 13:27:10 devstack sudo[85312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:11 devstack sudo[85310]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.534s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:11 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:27:11 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] Deleted volume successfully. Apr 16 13:27:11 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3f37931e-6dcd-472f-9c0b-82077f7053c5 tempest-VolumesTestJSON-2017820125 None] Lock "cinder-49f1c4d0-a2af-4418-9d3b-9d83e21cf052-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:11 devstack sudo[85312]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8" returned: 0 in 0.576s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:11 devstack sudo[85318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0 1G Apr 16 13:27:11 devstack sudo[85318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:11 devstack sudo[85318]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0 1G" returned: 0 in 0.647s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:11 devstack sudo[85324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0 Apr 16 13:27:11 devstack sudo[85324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:12 devstack sudo[85324]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0" returned: 0 in 0.497s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:12 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 13:27:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:12 devstack sudo[85329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0 Apr 16 13:27:12 devstack sudo[85329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:12 devstack sudo[85329]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0" returned: 0 in 0.495s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:12 devstack sudo[85332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.info Apr 16 13:27:12 devstack sudo[85332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:13 devstack sudo[85332]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.info" returned: 0 in 0.504s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:13 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 13:27:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:13 devstack sudo[85335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.info Apr 16 13:27:13 devstack sudo[85335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:13 devstack sudo[85335]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.info" returned: 0 in 0.499s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.272s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:14 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Creating offline snapshot 60e13e74-1785-4a62-8b9a-6233ce8ad35d of volume df93440f-93a5-4426-adca-d09fe5a787c4 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:27:14 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f5fd42-aa9e-4f54-a739-59bbee3e9cff]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:14 devstack sudo[85339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4 Apr 16 13:27:14 devstack sudo[85339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:14 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:27:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Flow 'volume_create_manager' (5cf42130-d2e1-4e3f-a60a-2995be342f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed607f2e-4079-440e-b6c3-b59268d39685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed607f2e-4079-440e-b6c3-b59268d39685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1880607051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63812327-7a59-4f80-b7bf-604671245b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc83411cbf5d4caa9741ac1ca643a29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:14Z,use_quota=True,user_id='df4ae9d406b344bcb84a302da3e214ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe32c7d8-4fc1-4cdf-9551-d2058dfdc58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe32c7d8-4fc1-4cdf-9551-d2058dfdc58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edf446c7-c649-43c8-81f6-d402fbcb44a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edf446c7-c649-43c8-81f6-d402fbcb44a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63812327-7a59-4f80-b7bf-604671245b2b', 'volume_name': 'volume-63812327-7a59-4f80-b7bf-604671245b2b', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78168c2-587c-419b-ad83-9073c67e4c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78168c2-587c-419b-ad83-9073c67e4c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac10bc7d-1147-4c6b-a86c-00db0f08aec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:14 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Volume 63812327-7a59-4f80-b7bf-604671245b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63812327-7a59-4f80-b7bf-604671245b2b', 'volume_size': 1} Apr 16 13:27:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:14 devstack sudo[85339]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4" returned: 0 in 0.640s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:14 devstack sudo[85344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d 1G Apr 16 13:27:14 devstack sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:15 devstack sudo[85344]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d 1G" returned: 0 in 0.590s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df93440f-93a5-4426-adca-d09fe5a787c4 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:15 devstack sudo[85349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df93440f-93a5-4426-adca-d09fe5a787c4 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d Apr 16 13:27:15 devstack sudo[85349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:15 devstack sudo[85349]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df93440f-93a5-4426-adca-d09fe5a787c4 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d" returned: 0 in 0.569s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:15 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d is being set with open permissions: ugo+rw: NotImplementedError Apr 16 13:27:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:15 devstack sudo[85354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d Apr 16 13:27:15 devstack sudo[85354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:16 devstack sudo[85354]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d" returned: 0 in 0.622s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:16 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:SELECT=117,cinder:UPDATE=131,cinder:INSERT=35,cinder:DELETE=7 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:27:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:16 devstack sudo[85358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.info Apr 16 13:27:16 devstack sudo[85358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:16 devstack sudo[85358]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.info" returned: 0 in 0.514s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:16 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 13:27:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:16 devstack sudo[85371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.info Apr 16 13:27:17 devstack sudo[85371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:17 devstack sudo[85371]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.info" returned: 0 in 0.509s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.509s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.061s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1880607051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63812327-7a59-4f80-b7bf-604671245b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc83411cbf5d4caa9741ac1ca643a29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:14Z,use_quota=True,user_id='df4ae9d406b344bcb84a302da3e214ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:27:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Creating volume 63812327-7a59-4f80-b7bf-604671245b2b {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:27:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:27:17 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:27:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:17 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:SELECT=111,cinder:UPDATE=121,cinder:DELETE=10,cinder:INSERT=20 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:27:17 devstack sudo[85379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b 1073741824 Apr 16 13:27:17 devstack sudo[85379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:17 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-4b26bdd4-670b-45cc-b600-572e85bf25f9 tempest-GroupSnapshotsTest-1532467286 None] group_snapshot 1a46dbdc-bdbd-4244-81bf-0743224c32fc: created successfully Apr 16 13:27:18 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] group_snapshot 1a46dbdc-bdbd-4244-81bf-0743224c32fc: deleting Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] group_snapshot 1a46dbdc-bdbd-4244-81bf-0743224c32fc: deleting {{(pid=83606) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "cinder-quobyte-66b72ef9-662c-46a2-9abb-7fcfe188c4f8" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-66b72ef9-662c-46a2-9abb-7fcfe188c4f8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "cinder-quobyte-10bb6937-61fe-4214-87e0-91d7ff0f6fa0" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-10bb6937-61fe-4214-87e0-91d7ff0f6fa0" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Deleting offline snapshot 10bb6937-61fe-4214-87e0-91d7ff0f6fa0 of volume 66b72ef9-662c-46a2-9abb-7fcfe188c4f8 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] snapshot_file for this snap is: volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[443f52a7-acfb-48ee-8806-e3f2515c8659]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:18 devstack sudo[85379]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b 1073741824" returned: 0 in 0.745s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:18 devstack sudo[85385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b Apr 16 13:27:18 devstack sudo[85385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:18 devstack sudo[85384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0 Apr 16 13:27:18 devstack sudo[85384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:18 devstack sudo[85385]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b" returned: 0 in 0.564s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac10bc7d-1147-4c6b-a86c-00db0f08aec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63812327-7a59-4f80-b7bf-604671245b2b', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c56761e-5bec-481b-bb9e-fa95cdd0fd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:18 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Volume volume-63812327-7a59-4f80-b7bf-604671245b2b (63812327-7a59-4f80-b7bf-604671245b2b): created successfully Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c56761e-5bec-481b-bb9e-fa95cdd0fd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Flow 'volume_create_manager' (5cf42130-d2e1-4e3f-a60a-2995be342f32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:18 devstack cinder-volume[83606]: INFO cinder.volume.manager [req-98a6a237-877c-4917-98ef-ac313eaa3d4c req-74a54538-23d8-489f-8e54-fb4ff02a53a0 tempest-VolumesSnapshotsTestJSON-566728988 None] Created volume successfully. Apr 16 13:27:18 devstack sudo[85384]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0" returned: 0 in 0.698s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55a2bd4-10e2-4a42-a636-9c0e39e1aae6]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:18 devstack sudo[85392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8 Apr 16 13:27:18 devstack sudo[85392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:19 devstack sudo[85392]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8" returned: 0 in 0.525s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:19 devstack sudo[85397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0 Apr 16 13:27:19 devstack sudo[85397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:19 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] Creating offline snapshot 25995321-e4fc-4fe3-8289-64fbcc5d218d of volume 63812327-7a59-4f80-b7bf-604671245b2b {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:27:19 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9504657d-92c2-4e10-b54c-cebbb5f6fbb4]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:20 devstack sudo[85397]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0" returned: 0 in 0.564s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:20 devstack sudo[85406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0 Apr 16 13:27:20 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:20 devstack sudo[85405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b Apr 16 13:27:20 devstack sudo[85405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:20 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-1b32e756-e841-456e-a974-c35884ea9100 tempest-GroupsV320Test-31537048 None] Group tempest-GroupsV320Test-Group-1633379532: creating Apr 16 13:27:20 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-1b32e756-e841-456e-a974-c35884ea9100 tempest-GroupsV320Test-31537048 None] Group tempest-GroupsV320Test-Group-1633379532: created successfully Apr 16 13:27:20 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-1b32e756-e841-456e-a974-c35884ea9100 tempest-GroupsV320Test-31537048 None] Create group completed successfully. Apr 16 13:27:20 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8.10bb6937-61fe-4214-87e0-91d7ff0f6fa0" returned: 0 in 0.496s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:20 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-10bb6937-61fe-4214-87e0-91d7ff0f6fa0" released by "_delete_snapshot" :: held 2.365s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:20 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-66b72ef9-662c-46a2-9abb-7fcfe188c4f8" released by "delete_snapshot" :: held 2.379s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:20 devstack sudo[85405]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b" returned: 0 in 0.540s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:20 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "cinder-quobyte-df93440f-93a5-4426-adca-d09fe5a787c4" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:20 devstack sudo[85413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d 1G Apr 16 13:27:20 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:20 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-df93440f-93a5-4426-adca-d09fe5a787c4" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:20 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "cinder-quobyte-60e13e74-1785-4a62-8b9a-6233ce8ad35d" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:20 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-60e13e74-1785-4a62-8b9a-6233ce8ad35d" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Deleting offline snapshot 60e13e74-1785-4a62-8b9a-6233ce8ad35d of volume df93440f-93a5-4426-adca-d09fe5a787c4 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:27:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] snapshot_file for this snap is: volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:27:20 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aff1bc1-822b-4697-813b-8490d6537ca1]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:20 devstack sudo[85415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d Apr 16 13:27:20 devstack sudo[85415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:21 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d 1G" returned: 0 in 0.498s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63812327-7a59-4f80-b7bf-604671245b2b -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:21 devstack sudo[85423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63812327-7a59-4f80-b7bf-604671245b2b -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d Apr 16 13:27:21 devstack sudo[85423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:21 devstack sudo[85415]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d" returned: 0 in 0.498s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:21 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df93440f-93a5-4426-adca-d09fe5a787c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:27:21 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb2279d-4e7d-4b09-84a3-cfd8b6f62289]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:21 devstack sudo[85425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4 Apr 16 13:27:21 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:21 devstack sudo[85423]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63812327-7a59-4f80-b7bf-604671245b2b -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d" returned: 0 in 0.830s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:21 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d is being set with open permissions: ugo+rw Apr 16 13:27:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:21 devstack sudo[85458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d Apr 16 13:27:21 devstack sudo[85458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:22 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4" returned: 0 in 0.954s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:22 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-04235c46-0b38-4af5-8b61-2e4662b6b46e tempest-GroupsV320Test-31537048 None] Created reservations ['b484156a-5a24-4a23-8257-5396b040b47c'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:22 devstack sudo[85462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d Apr 16 13:27:22 devstack sudo[85462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-04235c46-0b38-4af5-8b61-2e4662b6b46e tempest-GroupsV320Test-31537048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-04235c46-0b38-4af5-8b61-2e4662b6b46e tempest-GroupsV320Test-31537048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-04235c46-0b38-4af5-8b61-2e4662b6b46e tempest-GroupsV320Test-31537048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-04235c46-0b38-4af5-8b61-2e4662b6b46e tempest-GroupsV320Test-31537048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-04235c46-0b38-4af5-8b61-2e4662b6b46e tempest-GroupsV320Test-31537048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-04235c46-0b38-4af5-8b61-2e4662b6b46e tempest-GroupsV320Test-31537048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:22 devstack sudo[85464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:27:22 devstack sudo[85464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:22 devstack sudo[85458]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d" returned: 0 in 0.587s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:22 devstack sudo[85470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.info Apr 16 13:27:22 devstack sudo[85470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:22 devstack sudo[85464]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-04235c46-0b38-4af5-8b61-2e4662b6b46e tempest-GroupsV320Test-31537048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.529s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:22 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-04235c46-0b38-4af5-8b61-2e4662b6b46e tempest-GroupsV320Test-31537048 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:27:22 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-04235c46-0b38-4af5-8b61-2e4662b6b46e tempest-GroupsV320Test-31537048 None] Delete group completed successfully. Apr 16 13:27:22 devstack sudo[85462]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d" returned: 0 in 0.602s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:22 devstack sudo[85473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d Apr 16 13:27:22 devstack sudo[85473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:22 devstack sudo[85470]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.info" returned: 0 in 0.487s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:22 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.info is being set with open permissions: ugo+rw Apr 16 13:27:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:23 devstack sudo[85476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.info Apr 16 13:27:23 devstack sudo[85476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:23 devstack sudo[85473]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4.60e13e74-1785-4a62-8b9a-6233ce8ad35d" returned: 0 in 0.506s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-60e13e74-1785-4a62-8b9a-6233ce8ad35d" released by "_delete_snapshot" :: held 2.614s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-df93440f-93a5-4426-adca-d09fe5a787c4" released by "delete_snapshot" :: held 2.624s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:23 devstack cinder-volume[83606]: WARNING cinder.quota [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1796587075 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1796587075, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:27:23 devstack cinder-volume[83606]: WARNING cinder.quota [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1796587075 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1796587075, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:27:23 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Created reservations ['2f6ae6a3-449c-4ca6-b1a0-afdc9d5e9dd3', 'd2cfd874-f959-4b47-a793-c6a29165bbed', '120be4b8-485d-4799-8740-ead31c03f0a3', 'df7a9a89-4757-43fb-a8f3-3eb9c7737711'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:23 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] Created reservations ['ba505a10-fd58-4672-b8fe-3042afc0738c', '66f38027-cfd0-4172-b78a-acb5de59177a', 'a30c3200-daa1-4991-b944-7af78e834d23', '011916ec-5c8e-4887-a0fa-c78c6ea25e66'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:23 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-c2a1e2eb-497d-4539-abc9-3a37c8b3c4ea tempest-GroupSnapshotsTest-1532467286 None] group_snapshot 1a46dbdc-bdbd-4244-81bf-0743224c32fc: deleted successfully Apr 16 13:27:23 devstack sudo[85476]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.info" returned: 0 in 0.523s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.549s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:23 devstack cinder-volume[83606]: INFO cinder.volume.manager [req-74a2ffb8-36eb-41af-b73d-a79bcd2bb254 req-32ca5a92-e432-45fa-b63a-3d3e1a362085 tempest-VolumesSnapshotsTestJSON-566728988 None] Create snapshot completed successfully Apr 16 13:27:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "cinder-quobyte-66b72ef9-662c-46a2-9abb-7fcfe188c4f8" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-66b72ef9-662c-46a2-9abb-7fcfe188c4f8" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:23 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7699ca87-da94-4801-9407-354ecd3b3a87]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:23 devstack sudo[85481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8 Apr 16 13:27:23 devstack sudo[85481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:24 devstack sudo[85481]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8" returned: 0 in 0.630s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:24 devstack sudo[85486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8 Apr 16 13:27:24 devstack sudo[85486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Acquiring lock "cinder-25995321-e4fc-4fe3-8289-64fbcc5d218d-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "cinder-25995321-e4fc-4fe3-8289-64fbcc5d218d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Acquiring lock "cinder-quobyte-63812327-7a59-4f80-b7bf-604671245b2b" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "cinder-quobyte-63812327-7a59-4f80-b7bf-604671245b2b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Acquiring lock "cinder-quobyte-25995321-e4fc-4fe3-8289-64fbcc5d218d" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "cinder-quobyte-25995321-e4fc-4fe3-8289-64fbcc5d218d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Deleting offline snapshot 25995321-e4fc-4fe3-8289-64fbcc5d218d of volume 63812327-7a59-4f80-b7bf-604671245b2b {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:27:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] snapshot_file for this snap is: volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:27:24 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea39df0-383c-4bd0-ba82-0c45bd8b758b]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:24 devstack sudo[85488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d Apr 16 13:27:24 devstack sudo[85488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:25 devstack sudo[85486]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-66b72ef9-662c-46a2-9abb-7fcfe188c4f8" returned: 0 in 0.800s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:25 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-66b72ef9-662c-46a2-9abb-7fcfe188c4f8" released by "delete_volume" :: held 1.471s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:25 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "cinder-quobyte-df93440f-93a5-4426-adca-d09fe5a787c4" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:25 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-df93440f-93a5-4426-adca-d09fe5a787c4" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:25 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[01111546-986d-4ac6-ae40-2c24c0c57a3e]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:25 devstack sudo[85491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4 Apr 16 13:27:25 devstack sudo[85491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:25 devstack sudo[85488]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d" returned: 0 in 0.813s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:25 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63812327-7a59-4f80-b7bf-604671245b2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:27:25 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf62e57d-3948-4587-bc4e-da67d2c57e72]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:25 devstack sudo[85497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b Apr 16 13:27:25 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:25 devstack sudo[85491]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4" returned: 0 in 0.724s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:25 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4 Apr 16 13:27:25 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:26 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b" returned: 0 in 0.719s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:26 devstack sudo[85507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d Apr 16 13:27:26 devstack sudo[85507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:26 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-df93440f-93a5-4426-adca-d09fe5a787c4" returned: 0 in 0.515s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-df93440f-93a5-4426-adca-d09fe5a787c4" released by "delete_volume" :: held 1.280s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:26 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Created reservations ['11304731-86d7-4268-9a90-2b1f83928c8e'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:26 devstack cinder-volume[83606]: WARNING cinder.quota [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1796587075 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1796587075, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:27:26 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Created reservations ['7e6b7afd-871b-440d-8df7-7bea381f4ace', '7b857099-845e-4deb-828a-b48a0015483e', 'fbf0127a-7322-4f23-a400-06f3b1a59811', '9d61b594-57f2-48f0-85f7-845b7f6ab6e2'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:26 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Created reservations ['637efa9d-c1b0-41de-8bbf-b9f1eb2a9046', 'e9a8573b-2378-4d15-9a9b-d440967f5883', '27106d1d-3e59-43ef-aac9-b71ebe7bff85', '791ecb58-a3dd-4f8e-a054-b8493c588905'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:26 devstack sudo[85513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:27:26 devstack sudo[85513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:26 devstack sudo[85507]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d" returned: 0 in 0.636s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:26 devstack sudo[85515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d Apr 16 13:27:26 devstack sudo[85515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:27 devstack sudo[85513]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.561s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:27 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:27:27 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-a449e782-03c7-4eec-96eb-baf4204c878a tempest-GroupSnapshotsTest-1532467286 None] Delete group completed successfully. Apr 16 13:27:27 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d05fb944-b064-446d-b86b-003cfd9d430f tempest-GroupSnapshotsTest-1532467286 None] Group tempest-GroupSnapshotsTest-Group-1049655393: creating Apr 16 13:27:27 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d05fb944-b064-446d-b86b-003cfd9d430f tempest-GroupSnapshotsTest-1532467286 None] Group tempest-GroupSnapshotsTest-Group-1049655393: created successfully Apr 16 13:27:27 devstack sudo[85515]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b.25995321-e4fc-4fe3-8289-64fbcc5d218d" returned: 0 in 0.546s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:27 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d05fb944-b064-446d-b86b-003cfd9d430f tempest-GroupSnapshotsTest-1532467286 None] Create group completed successfully. Apr 16 13:27:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "cinder-quobyte-25995321-e4fc-4fe3-8289-64fbcc5d218d" released by "_delete_snapshot" :: held 2.775s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "cinder-quobyte-63812327-7a59-4f80-b7bf-604671245b2b" released by "delete_snapshot" :: held 2.790s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:27 devstack cinder-volume[83606]: WARNING cinder.quota [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:27:27 devstack cinder-volume[83606]: DEBUG cinder.quota [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Created reservations ['38de09f6-8b7b-4e7e-9235-45efb4378053', '47392c8a-82a1-4577-8248-315ed35a862e', '8e0a184d-a1e5-43a8-b425-1c9dce1b3dd6', 'b4bebf48-97a1-4d1b-8761-5f8ecd83cb8a'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:27 devstack cinder-volume[83606]: INFO cinder.volume.manager [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Delete snapshot completed successfully. Apr 16 13:27:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-87f12d0a-ae3f-414b-9034-f3d191903994 req-b5a08dba-ac95-4852-9bd1-4a297ba00fd7 tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "cinder-25995321-e4fc-4fe3-8289-64fbcc5d218d-delete_snapshot" released by "delete_snapshot" :: held 2.903s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] Acquiring lock "cinder-63812327-7a59-4f80-b7bf-604671245b2b-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "cinder-63812327-7a59-4f80-b7bf-604671245b2b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] Acquiring lock "cinder-quobyte-63812327-7a59-4f80-b7bf-604671245b2b" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "cinder-quobyte-63812327-7a59-4f80-b7bf-604671245b2b" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:27 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[388828c3-524c-481c-88b0-3aa85a630a1b]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:28 devstack sudo[85519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b Apr 16 13:27:28 devstack sudo[85519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:28 devstack sudo[85519]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b" returned: 0 in 0.617s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:28 devstack sudo[85524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b Apr 16 13:27:28 devstack sudo[85524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Flow 'volume_create_manager' (e881a35a-e782-4094-a3c8-e5010a27ad95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904e415f-7e7c-41f8-83e6-a82e7afc0b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904e415f-7e7c-41f8-83e6-a82e7afc0b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-26181930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1851f383-53d8-4ff0-a361-05cc7e9666e8,host='devstack@QuobyteHD#QuobyteHD',id=9b2d12a1-5601-40f0-b346-79d31624f8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085ce34bb5314c07a4039dd1006aa8de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:29Z,use_quota=True,user_id='3cd2135733444c01be9145f2e00c61fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(691ff35f-36a6-48df-959b-5b4b62afb59a),volume_type_id=691ff35f-36a6-48df-959b-5b4b62afb59a)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be9b436-5548-4230-9a2b-1a2719bfd430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be9b436-5548-4230-9a2b-1a2719bfd430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f935fcd1-9ff2-40da-afad-cedeca4e1fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f935fcd1-9ff2-40da-afad-cedeca4e1fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b2d12a1-5601-40f0-b346-79d31624f8ae', 'volume_name': 'volume-9b2d12a1-5601-40f0-b346-79d31624f8ae', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb8fcbb-6f0d-4a4d-a619-99b640d4bb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb8fcbb-6f0d-4a4d-a619-99b640d4bb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3044d3-0d07-459a-bcee-29165cf064fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:28 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Volume 9b2d12a1-5601-40f0-b346-79d31624f8ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b2d12a1-5601-40f0-b346-79d31624f8ae', 'volume_size': 1} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1851f383-53d8-4ff0-a361-05cc7e9666e8,created_at=2026-04-16T11:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-26181930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1851f383-53d8-4ff0-a361-05cc7e9666e8,host='devstack@QuobyteHD#QuobyteHD',id=9b2d12a1-5601-40f0-b346-79d31624f8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085ce34bb5314c07a4039dd1006aa8de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:29Z,use_quota=True,user_id='3cd2135733444c01be9145f2e00c61fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(691ff35f-36a6-48df-959b-5b4b62afb59a),volume_type_id=691ff35f-36a6-48df-959b-5b4b62afb59a)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Creating volume 9b2d12a1-5601-40f0-b346-79d31624f8ae {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:27:28 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:27:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:28 devstack sudo[85533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae 1073741824 Apr 16 13:27:28 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:29 devstack sudo[85524]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-63812327-7a59-4f80-b7bf-604671245b2b" returned: 0 in 0.829s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "cinder-quobyte-63812327-7a59-4f80-b7bf-604671245b2b" released by "delete_volume" :: held 1.544s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:29 devstack cinder-volume[83606]: DEBUG cinder.quota [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] Created reservations ['98343b38-35ac-4837-b7ac-957760c10029', '44ffecf4-c074-4006-8ed8-b723c15b9463', 'bbbabef1-5c69-4d82-bf0c-609f180f331c', '330de134-c7c8-42f6-b7cd-5927cf9c373c'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:29 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:29 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:29 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:29 devstack sudo[85561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:27:29 devstack sudo[85561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae 1073741824" returned: 0 in 0.673s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:29 devstack sudo[85563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae Apr 16 13:27:29 devstack sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:30 devstack sudo[85563]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae" returned: 0 in 0.593s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:27:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3044d3-0d07-459a-bcee-29165cf064fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b2d12a1-5601-40f0-b346-79d31624f8ae', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8ea204-e408-4775-9316-3e6937d1cb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:30 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Volume volume-9b2d12a1-5601-40f0-b346-79d31624f8ae (9b2d12a1-5601-40f0-b346-79d31624f8ae): created successfully Apr 16 13:27:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8ea204-e408-4775-9316-3e6937d1cb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Flow 'volume_create_manager' (e881a35a-e782-4094-a3c8-e5010a27ad95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:30 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-b0240d18-aa4c-45c6-9488-46108946f104 tempest-GroupSnapshotsTest-1532467286 None] Created volume successfully. Apr 16 13:27:30 devstack sudo[85561]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.828s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:30 devstack cinder-volume[83606]: DEBUG cinder.manager [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:27:30 devstack cinder-volume[83606]: INFO cinder.volume.manager [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] Deleted volume successfully. Apr 16 13:27:30 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-32228a88-0f38-4453-8208-88dd3459a4d1 req-e5a7c351-7d47-46d5-ba8c-994487369c6a tempest-VolumesSnapshotsTestJSON-566728988 None] Lock "cinder-63812327-7a59-4f80-b7bf-604671245b2b-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:31 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] GroupSnapshot 25fade84-669c-4713-80f3-f9bfbc0888fb: creating. Apr 16 13:27:31 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] Group snapshot 25fade84-669c-4713-80f3-f9bfbc0888fb: creating. {{(pid=83606) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 13:27:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:31 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] Creating offline snapshot 98cd9e67-b5a2-4117-b0da-7eebfb6c1261 of volume 9b2d12a1-5601-40f0-b346-79d31624f8ae {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:27:31 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e65b4a-b993-4e40-a2a8-657c97f5c7a1]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:31 devstack sudo[85574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae Apr 16 13:27:31 devstack sudo[85574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:32 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:27:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Flow 'volume_create_manager' (b7867cd9-16fa-467f-8bf4-292acce337b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a128ba64-bc44-4e1f-873d-ef9740e64378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a128ba64-bc44-4e1f-873d-ef9740e64378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-727039264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573d2227-75bc-4a4c-86dc-deace40f4df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0ac420d0b348f5a7254ea2575215aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:32Z,use_quota=True,user_id='027e4966c3764b328d8c979b75a9ab3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28370d12-52af-40d2-8395-6fc6c79a5f4a),volume_type_id=28370d12-52af-40d2-8395-6fc6c79a5f4a)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3410106f-9ef7-42bf-bb13-80e425db3258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3410106f-9ef7-42bf-bb13-80e425db3258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab93e682-cc62-4183-9657-6f8d04b9f5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab93e682-cc62-4183-9657-6f8d04b9f5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '573d2227-75bc-4a4c-86dc-deace40f4df4', 'volume_name': 'volume-573d2227-75bc-4a4c-86dc-deace40f4df4', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d58ce64-d3e8-491b-863f-8c1a0475d1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d58ce64-d3e8-491b-863f-8c1a0475d1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7ca11d-0025-41c3-8986-e60f9ebbee17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:32 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Volume 573d2227-75bc-4a4c-86dc-deace40f4df4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-573d2227-75bc-4a4c-86dc-deace40f4df4', 'volume_size': 1} Apr 16 13:27:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:32 devstack sudo[85574]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae" returned: 0 in 0.810s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:32 devstack sudo[85579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261 1G Apr 16 13:27:32 devstack sudo[85579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:32 devstack sudo[85579]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261 1G" returned: 0 in 0.670s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2d12a1-5601-40f0-b346-79d31624f8ae -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:32 devstack sudo[85584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2d12a1-5601-40f0-b346-79d31624f8ae -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261 Apr 16 13:27:32 devstack sudo[85584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:33 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:27:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Flow 'volume_create_manager' (6747b57e-9d1c-47bf-a4d0-c05a87917156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d47ca8-fd53-4a0f-9f32-2fb1bf7c66c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d47ca8-fd53-4a0f-9f32-2fb1bf7c66c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1920230684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb79b1af-778a-43c3-971c-8ada437ccbfc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c438c168f7c1486f9abd273d44dd792d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:33Z,use_quota=True,user_id='de643f6db63b435d9ca413ac4d16d382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d6782e-45d6-451e-bf1a-5b23dbe80884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d6782e-45d6-451e-bf1a-5b23dbe80884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad37655-2c89-490e-92c8-a29a423c4c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad37655-2c89-490e-92c8-a29a423c4c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb79b1af-778a-43c3-971c-8ada437ccbfc', 'volume_name': 'volume-eb79b1af-778a-43c3-971c-8ada437ccbfc', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63111013-dabd-4bc2-b945-2bd1ce3caa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63111013-dabd-4bc2-b945-2bd1ce3caa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914edd35-7409-4530-9054-4f8c468b74c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:33 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Volume eb79b1af-778a-43c3-971c-8ada437ccbfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb79b1af-778a-43c3-971c-8ada437ccbfc', 'volume_size': 1} Apr 16 13:27:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:33 devstack sudo[85584]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2d12a1-5601-40f0-b346-79d31624f8ae -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261" returned: 0 in 0.590s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:33 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 13:27:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:33 devstack sudo[85589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261 Apr 16 13:27:33 devstack sudo[85589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:33 devstack sudo[85589]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261" returned: 0 in 0.452s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:33 devstack sudo[85596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.info Apr 16 13:27:33 devstack sudo[85596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:34 devstack sudo[85596]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.info" returned: 0 in 0.447s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:34 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:34 devstack sudo[85599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.info Apr 16 13:27:34 devstack sudo[85599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG oslo_service.periodic_task [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83606) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:34 devstack sudo[85601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:27:34 devstack sudo[85601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:34 devstack sudo[85599]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.info" returned: 0 in 0.456s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.492s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.672s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-727039264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573d2227-75bc-4a4c-86dc-deace40f4df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0ac420d0b348f5a7254ea2575215aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:32Z,use_quota=True,user_id='027e4966c3764b328d8c979b75a9ab3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28370d12-52af-40d2-8395-6fc6c79a5f4a),volume_type_id=28370d12-52af-40d2-8395-6fc6c79a5f4a)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Creating volume 573d2227-75bc-4a4c-86dc-deace40f4df4 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:27:34 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-573d2227-75bc-4a4c-86dc-deace40f4df4 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:34 devstack sudo[85605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-573d2227-75bc-4a4c-86dc-deace40f4df4 1073741824 Apr 16 13:27:34 devstack sudo[85605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:34 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-0d871d30-1bc5-4381-9d7f-f1bfdc86e8b3 tempest-GroupSnapshotsTest-1532467286 None] group_snapshot 25fade84-669c-4713-80f3-f9bfbc0888fb: created successfully Apr 16 13:27:34 devstack sudo[85601]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.468s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:34 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:27:35 devstack sudo[85605]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-573d2227-75bc-4a4c-86dc-deace40f4df4 1073741824" returned: 0 in 0.573s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-573d2227-75bc-4a4c-86dc-deace40f4df4 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:35 devstack sudo[85610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-573d2227-75bc-4a4c-86dc-deace40f4df4 Apr 16 13:27:35 devstack sudo[85610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:35 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] group_snapshot 25fade84-669c-4713-80f3-f9bfbc0888fb: deleting Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] group_snapshot 25fade84-669c-4713-80f3-f9bfbc0888fb: deleting {{(pid=83606) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "cinder-quobyte-9b2d12a1-5601-40f0-b346-79d31624f8ae" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-9b2d12a1-5601-40f0-b346-79d31624f8ae" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "cinder-quobyte-98cd9e67-b5a2-4117-b0da-7eebfb6c1261" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-98cd9e67-b5a2-4117-b0da-7eebfb6c1261" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] Deleting offline snapshot 98cd9e67-b5a2-4117-b0da-7eebfb6c1261 of volume 9b2d12a1-5601-40f0-b346-79d31624f8ae {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] snapshot_file for this snap is: volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddac33e-259e-43ff-a4cc-6908f75f6277]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:35 devstack sudo[85612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261 Apr 16 13:27:35 devstack sudo[85612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:35 devstack sudo[85610]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-573d2227-75bc-4a4c-86dc-deace40f4df4" returned: 0 in 0.427s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.642s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1920230684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb79b1af-778a-43c3-971c-8ada437ccbfc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c438c168f7c1486f9abd273d44dd792d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:33Z,use_quota=True,user_id='de643f6db63b435d9ca413ac4d16d382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Creating volume eb79b1af-778a-43c3-971c-8ada437ccbfc {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:27:35 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-eb79b1af-778a-43c3-971c-8ada437ccbfc 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7ca11d-0025-41c3-8986-e60f9ebbee17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-573d2227-75bc-4a4c-86dc-deace40f4df4', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983c3593-44f4-41ec-a157-efc9e37d16b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:35 devstack sudo[85615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-eb79b1af-778a-43c3-971c-8ada437ccbfc 1073741824 Apr 16 13:27:35 devstack sudo[85615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:35 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Volume volume-573d2227-75bc-4a4c-86dc-deace40f4df4 (573d2227-75bc-4a4c-86dc-deace40f4df4): created successfully Apr 16 13:27:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983c3593-44f4-41ec-a157-efc9e37d16b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Flow 'volume_create_manager' (b7867cd9-16fa-467f-8bf4-292acce337b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:36 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-66204048-3a5c-46bf-91dc-5cab00f672a8 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Created volume successfully. Apr 16 13:27:36 devstack sudo[85612]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261" returned: 0 in 0.545s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b2d12a1-5601-40f0-b346-79d31624f8ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:27:36 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4240a491-fdf1-465c-be60-4441ba0d0639]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:36 devstack sudo[85620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae Apr 16 13:27:36 devstack sudo[85620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:36 devstack sudo[85615]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-eb79b1af-778a-43c3-971c-8ada437ccbfc 1073741824" returned: 0 in 0.643s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-eb79b1af-778a-43c3-971c-8ada437ccbfc {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-25083e92-492c-458e-8c8c-adfef6ee25aa tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-25083e92-492c-458e-8c8c-adfef6ee25aa tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-25083e92-492c-458e-8c8c-adfef6ee25aa tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-25083e92-492c-458e-8c8c-adfef6ee25aa tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-25083e92-492c-458e-8c8c-adfef6ee25aa tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-25083e92-492c-458e-8c8c-adfef6ee25aa tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:36 devstack sudo[85625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-eb79b1af-778a-43c3-971c-8ada437ccbfc Apr 16 13:27:36 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:36 devstack sudo[85626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:27:36 devstack sudo[85626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:36 devstack sudo[85620]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae" returned: 0 in 0.611s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:36 devstack sudo[85632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261 Apr 16 13:27:36 devstack sudo[85632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:37 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-eb79b1af-778a-43c3-971c-8ada437ccbfc" returned: 0 in 0.492s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914edd35-7409-4530-9054-4f8c468b74c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb79b1af-778a-43c3-971c-8ada437ccbfc', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0d326e-dd27-4b3c-a07b-c25ee5f43750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:37 devstack sudo[85626]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-25083e92-492c-458e-8c8c-adfef6ee25aa tempest-VolumeRetypeWithoutMigrationTest-833531174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.517s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-25083e92-492c-458e-8c8c-adfef6ee25aa tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:27:37 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Volume volume-eb79b1af-778a-43c3-971c-8ada437ccbfc (eb79b1af-778a-43c3-971c-8ada437ccbfc): created successfully Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0d326e-dd27-4b3c-a07b-c25ee5f43750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Flow 'volume_create_manager' (6747b57e-9d1c-47bf-a4d0-c05a87917156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:37 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-25083e92-492c-458e-8c8c-adfef6ee25aa tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Retype volume completed successfully. Apr 16 13:27:37 devstack cinder-volume[83606]: INFO cinder.volume.manager [req-3cb20bdb-1df5-47d8-9d36-76087e265eba req-3a53df61-15b0-4140-b688-8c2e9baa1b1e tempest-VolumesGetTestJSON-1426524453 None] Created volume successfully. Apr 16 13:27:37 devstack sudo[85632]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261" returned: 0 in 0.477s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:37 devstack sudo[85639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261 Apr 16 13:27:37 devstack sudo[85639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] Acquiring lock "cinder-eb79b1af-778a-43c3-971c-8ada437ccbfc-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] Lock "cinder-eb79b1af-778a-43c3-971c-8ada437ccbfc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] Acquiring lock "cinder-quobyte-eb79b1af-778a-43c3-971c-8ada437ccbfc" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] Lock "cinder-quobyte-eb79b1af-778a-43c3-971c-8ada437ccbfc" acquired by "delete_volume" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[992f74c8-693c-4dc0-8008-626aba31d386]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-eb79b1af-778a-43c3-971c-8ada437ccbfc {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:37 devstack sudo[85639]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:37 devstack sudo[85642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-eb79b1af-778a-43c3-971c-8ada437ccbfc Apr 16 13:27:37 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae.98cd9e67-b5a2-4117-b0da-7eebfb6c1261" returned: 0 in 0.523s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-98cd9e67-b5a2-4117-b0da-7eebfb6c1261" released by "_delete_snapshot" :: held 2.221s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-9b2d12a1-5601-40f0-b346-79d31624f8ae" released by "delete_snapshot" :: held 2.231s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Acquiring lock "cinder-573d2227-75bc-4a4c-86dc-deace40f4df4-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Lock "cinder-573d2227-75bc-4a4c-86dc-deace40f4df4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:38 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Acquiring lock "cinder-quobyte-573d2227-75bc-4a4c-86dc-deace40f4df4" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:38 devstack cinder-volume[83606]: WARNING cinder.quota [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1401953723 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1401953723, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:27:38 devstack cinder-volume[83606]: WARNING cinder.quota [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1401953723 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1401953723, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:27:38 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Lock "cinder-quobyte-573d2227-75bc-4a4c-86dc-deace40f4df4" acquired by "delete_volume" :: waited 0.025s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:38 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dd4ecb-4db9-4364-865a-26c509cf54f4]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-573d2227-75bc-4a4c-86dc-deace40f4df4 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:38 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] Created reservations ['a5f7390a-1333-4d30-8178-67daf6f276bf', 'e075c67d-453f-4f5f-8c82-646252b8baf5', 'f4101ad9-525a-4126-af33-5cbb6e1d1345', 'f93e165f-5d2f-4cf1-963f-134a553d6bb3'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:38 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-0125727a-44c9-48fc-a2f0-60cc989ef6c5 tempest-GroupSnapshotsTest-1532467286 None] group_snapshot 25fade84-669c-4713-80f3-f9bfbc0888fb: deleted successfully Apr 16 13:27:38 devstack sudo[85644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-573d2227-75bc-4a4c-86dc-deace40f4df4 Apr 16 13:27:38 devstack sudo[85644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:38 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-eb79b1af-778a-43c3-971c-8ada437ccbfc" returned: 0 in 0.629s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-eb79b1af-778a-43c3-971c-8ada437ccbfc {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:38 devstack sudo[85649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-eb79b1af-778a-43c3-971c-8ada437ccbfc Apr 16 13:27:38 devstack sudo[85649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:38 devstack sudo[85644]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-573d2227-75bc-4a4c-86dc-deace40f4df4" returned: 0 in 0.615s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-573d2227-75bc-4a4c-86dc-deace40f4df4 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:38 devstack sudo[85655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-573d2227-75bc-4a4c-86dc-deace40f4df4 Apr 16 13:27:38 devstack sudo[85655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "cinder-quobyte-9b2d12a1-5601-40f0-b346-79d31624f8ae" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-9b2d12a1-5601-40f0-b346-79d31624f8ae" acquired by "delete_volume" :: waited 0.015s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6257537-37a5-44cf-897d-26e5500e0aa8]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:39 devstack sudo[85649]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-eb79b1af-778a-43c3-971c-8ada437ccbfc" returned: 0 in 0.773s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] Lock "cinder-quobyte-eb79b1af-778a-43c3-971c-8ada437ccbfc" released by "delete_volume" :: held 1.432s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG cinder.quota [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] Created reservations ['9cd060b0-5301-48a1-ac4f-2c6f0c8505d3', '3f55311f-ed21-417d-bdd0-194b532ea895', '858220b2-5384-44f4-aa98-1b5dcee53c01', '52a988ba-b367-4928-98e5-7f153d4b2410'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:39 devstack sudo[85658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae Apr 16 13:27:39 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:39 devstack sudo[85662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:27:39 devstack sudo[85662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:39 devstack sudo[85655]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-573d2227-75bc-4a4c-86dc-deace40f4df4" returned: 0 in 0.796s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Lock "cinder-quobyte-573d2227-75bc-4a4c-86dc-deace40f4df4" released by "delete_volume" :: held 1.444s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:39 devstack cinder-volume[83606]: WARNING cinder.quota [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:27:39 devstack cinder-volume[83606]: WARNING cinder.quota [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Created reservations ['77a26c8e-4ba7-4b76-9950-ea36a292c488', '467b1d8c-1c88-4822-9330-62d8362d1ae8', 'd72c0888-44f5-43f2-b2b0-2b0b0d704a93', '1e4d0ad5-eac4-4626-8f60-1ec7b6335e53'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:39 devstack sudo[85664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:27:39 devstack sudo[85664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Flow 'volume_create_manager' (7da5086d-9f61-44c2-85d4-1231c13b0be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b3a76d-5f9c-47dc-a273-171afbc5f328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b3a76d-5f9c-47dc-a273-171afbc5f328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:40Z,deleted=False,deleted_at=None,display_description='',display_name='36a30e9b-31f2-44d1-a70a-111382ba2f6a-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8995b2-ac10-43a8-b9d2-a70d9f0156fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e85a64a9ea84b27b880e897414a2f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:40Z,use_quota=True,user_id='039e615edc4d4dfdacb1ab734c3897be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72934d3a-a0a8-43e5-860b-49f3ffbce530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72934d3a-a0a8-43e5-860b-49f3ffbce530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71894f8a-11b1-46cc-b98e-e85d30f29fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71894f8a-11b1-46cc-b98e-e85d30f29fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f8995b2-ac10-43a8-b9d2-a70d9f0156fb', 'volume_name': 'volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfe115d-584a-42af-9c14-9ec2cceba72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfe115d-584a-42af-9c14-9ec2cceba72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7247c68c-5fa0-4576-8cb8-db52a93a73a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:40 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Volume 5f8995b2-ac10-43a8-b9d2-a70d9f0156fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb', 'volume_size': 1} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:40Z,deleted=False,deleted_at=None,display_description='',display_name='36a30e9b-31f2-44d1-a70a-111382ba2f6a-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8995b2-ac10-43a8-b9d2-a70d9f0156fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e85a64a9ea84b27b880e897414a2f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:40Z,use_quota=True,user_id='039e615edc4d4dfdacb1ab734c3897be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Creating volume 5f8995b2-ac10-43a8-b9d2-a70d9f0156fb {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:27:40 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:40 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae" returned: 0 in 1.161s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:40 devstack sudo[85670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb 1073741824 Apr 16 13:27:40 devstack sudo[85670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:40 devstack sudo[85671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae Apr 16 13:27:40 devstack sudo[85671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:40 devstack sudo[85662]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 1.199s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.manager [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:27:40 devstack cinder-volume[83606]: INFO cinder.volume.manager [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] Deleted volume successfully. Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-80201bb4-a921-4779-b4c3-a02a17315a3c req-ffbf047d-fa20-405e-984e-1ecf1b6bfba7 tempest-VolumesGetTestJSON-1426524453 None] Lock "cinder-eb79b1af-778a-43c3-971c-8ada437ccbfc-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:40 devstack sudo[85664]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 1.065s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:27:40 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Deleted volume successfully. Apr 16 13:27:40 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-742fe846-f103-4ae8-a2d7-48d7654ebee3 tempest-VolumeRetypeWithoutMigrationTest-833531174 None] Lock "cinder-573d2227-75bc-4a4c-86dc-deace40f4df4-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:41 devstack sudo[85671]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9b2d12a1-5601-40f0-b346-79d31624f8ae" returned: 0 in 0.746s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:41 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] Lock "cinder-quobyte-9b2d12a1-5601-40f0-b346-79d31624f8ae" released by "delete_volume" :: held 1.946s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:41 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] Created reservations ['e8d66908-3413-479a-bc31-7cba980eb88d'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:41 devstack cinder-volume[83606]: WARNING cinder.quota [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1401953723 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1401953723, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:27:41 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] Created reservations ['fd7a5084-7ea9-4391-b95e-44616020acac', '7fdf50cb-e442-4d1b-b816-5ec5594621d6', '149d5ec6-4a64-41e4-8fcb-64082b106ec3', '2cbc7bd7-30c4-470a-aabe-26ba605cbca8'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:41 devstack sudo[85680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:27:41 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:41 devstack sudo[85670]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb 1073741824" returned: 0 in 1.138s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:41 devstack sudo[85682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb Apr 16 13:27:41 devstack sudo[85682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:42 devstack sudo[85682]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb" returned: 0 in 0.691s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:27:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7247c68c-5fa0-4576-8cb8-db52a93a73a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8128494-96fc-4256-a083-96b408b75bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:42 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Volume volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb (5f8995b2-ac10-43a8-b9d2-a70d9f0156fb): created successfully Apr 16 13:27:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8128494-96fc-4256-a083-96b408b75bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Flow 'volume_create_manager' (7da5086d-9f61-44c2-85d4-1231c13b0be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:42 devstack cinder-volume[83606]: INFO cinder.volume.manager [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-a7fd0fb0-fcad-4a31-8b6a-20868191d867 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Created volume successfully. Apr 16 13:27:42 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.977s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:42 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:27:42 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-3b46a369-30be-4bb1-8441-90f9fa852635 tempest-GroupSnapshotsTest-1532467286 None] Delete group completed successfully. Apr 16 13:27:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-fd945775-b29f-4e28-be63-0ce8cd7abf59 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-fd945775-b29f-4e28-be63-0ce8cd7abf59 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:43 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c0e02b-490c-4537-b83c-2ce94f08e464]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-fd945775-b29f-4e28-be63-0ce8cd7abf59 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:43 devstack sudo[85700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb Apr 16 13:27:43 devstack sudo[85700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:44 devstack sudo[85700]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-fd945775-b29f-4e28-be63-0ce8cd7abf59 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb" returned: 0 in 0.973s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-fd945775-b29f-4e28-be63-0ce8cd7abf59 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.994s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-fd945775-b29f-4e28-be63-0ce8cd7abf59 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912', 'name': 'volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2592966b-40fb-45e4-9e17-bbc36dae46be', 'enforce_multipath': True} {{(pid=83606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 13:27:44 devstack cinder-volume[83606]: INFO cinder.volume.manager [req-5c49504b-7cf8-481b-9bc5-010b79fb6e65 req-fd945775-b29f-4e28-be63-0ce8cd7abf59 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] attachment_update completed successfully. Apr 16 13:27:45 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-cda34ce4-5962-4fa3-a873-d8f15e07c808 tempest-BackendsCapabilitiesAdminTestsJSON-142111684 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327880859375, 'free_capacity_gb': 1775.7327880859375, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83606) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 16 13:27:45 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-915ea562-49f7-4724-b34b-45a78e675b3e tempest-BackendsCapabilitiesAdminTestsJSON-142111684 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327880859375, 'free_capacity_gb': 1775.7327880859375, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83606) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 16 13:27:46 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-93bdb5c7-e034-4794-8264-6a7c622c15b4 tempest-GroupSnapshotsV319Test-1355707268 None] Group tempest-GroupSnapshotsV319Test-Group-1365221371: creating Apr 16 13:27:46 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-93bdb5c7-e034-4794-8264-6a7c622c15b4 tempest-GroupSnapshotsV319Test-1355707268 None] Group tempest-GroupSnapshotsV319Test-Group-1365221371: created successfully Apr 16 13:27:46 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-93bdb5c7-e034-4794-8264-6a7c622c15b4 tempest-GroupSnapshotsV319Test-1355707268 None] Create group completed successfully. Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Flow 'volume_create_manager' (afa44e0a-915e-4c20-b949-57cafa0a4832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5ddffb-d818-48f5-ae56-afb076834c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5ddffb-d818-48f5-ae56-afb076834c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1381657688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6bb9f4d-abc5-4873-9527-3d7bbfae5fb3,host='devstack@QuobyteHD#QuobyteHD',id=e0a6669a-4376-486e-addd-cfba55f5676f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e62f8d1d12c4621a798d0a6127c21b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:48Z,use_quota=True,user_id='2657d28e2fce410a9f4b3cb40b110220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac62353d-dcec-43df-8b06-21be30998bdd),volume_type_id=ac62353d-dcec-43df-8b06-21be30998bdd)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86068d9-3222-42ef-b44e-8381df4e6326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86068d9-3222-42ef-b44e-8381df4e6326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f557e05-2c35-4d5c-b20c-114058c4f8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f557e05-2c35-4d5c-b20c-114058c4f8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0a6669a-4376-486e-addd-cfba55f5676f', 'volume_name': 'volume-e0a6669a-4376-486e-addd-cfba55f5676f', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc246b83-318d-42ce-a913-cf29278e005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc246b83-318d-42ce-a913-cf29278e005a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cb915f-44d6-401a-8576-70f4187228a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:48 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Volume e0a6669a-4376-486e-addd-cfba55f5676f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0a6669a-4376-486e-addd-cfba55f5676f', 'volume_size': 1} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c6bb9f4d-abc5-4873-9527-3d7bbfae5fb3,created_at=2026-04-16T11:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1381657688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6bb9f4d-abc5-4873-9527-3d7bbfae5fb3,host='devstack@QuobyteHD#QuobyteHD',id=e0a6669a-4376-486e-addd-cfba55f5676f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e62f8d1d12c4621a798d0a6127c21b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:48Z,use_quota=True,user_id='2657d28e2fce410a9f4b3cb40b110220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac62353d-dcec-43df-8b06-21be30998bdd),volume_type_id=ac62353d-dcec-43df-8b06-21be30998bdd)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Creating volume e0a6669a-4376-486e-addd-cfba55f5676f {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:27:48 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:48 devstack sudo[85808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f 1073741824 Apr 16 13:27:48 devstack sudo[85808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:48 devstack sudo[85808]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f 1073741824" returned: 0 in 0.634s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:49 devstack sudo[85813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f Apr 16 13:27:49 devstack sudo[85813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:49 devstack sudo[85813]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f" returned: 0 in 0.825s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:27:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cb915f-44d6-401a-8576-70f4187228a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a6669a-4376-486e-addd-cfba55f5676f', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b21ccce-bbe3-426f-a13d-bb289d8eaa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:49 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Volume volume-e0a6669a-4376-486e-addd-cfba55f5676f (e0a6669a-4376-486e-addd-cfba55f5676f): created successfully Apr 16 13:27:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b21ccce-bbe3-426f-a13d-bb289d8eaa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Flow 'volume_create_manager' (afa44e0a-915e-4c20-b949-57cafa0a4832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:49 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-eca1040f-5edc-43d8-907d-5026d5d03950 tempest-GroupSnapshotsV319Test-1355707268 None] Created volume successfully. Apr 16 13:27:50 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] GroupSnapshot 59a8e327-f412-4f56-b578-4124c2d322c1: creating. Apr 16 13:27:50 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] Group snapshot 59a8e327-f412-4f56-b578-4124c2d322c1: creating. {{(pid=83606) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 13:27:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:50 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] Creating offline snapshot bb00893d-5ab0-4919-8783-6aa4ff85a5f2 of volume e0a6669a-4376-486e-addd-cfba55f5676f {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:27:50 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dffb9a3-48ba-4100-8dc4-1ef01ba3de5e]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:50 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f Apr 16 13:27:50 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:50 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:27:50 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Flow 'volume_create_manager' (3fa9bb7f-ce7c-4073-a907-194fa43d7e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd04582-da21-4734-aa29-5e35bbedcaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd04582-da21-4734-aa29-5e35bbedcaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1850351517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81790c87-b67a-4028-9a42-42c5af553d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacf292b569e4d1bbac538d238d01066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:51Z,use_quota=True,user_id='3025b5bc006b4e46b99f9409c6ed6258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058320f7-6093-417d-81fa-086ce7e789ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058320f7-6093-417d-81fa-086ce7e789ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b73bd9d-3f38-463d-81f8-d0b9f3bb0600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b73bd9d-3f38-463d-81f8-d0b9f3bb0600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81790c87-b67a-4028-9a42-42c5af553d39', 'volume_name': 'volume-81790c87-b67a-4028-9a42-42c5af553d39', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4568c7-9f59-4f29-ba0b-726086d2c66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4568c7-9f59-4f29-ba0b-726086d2c66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09218288-4458-4bce-a2ab-1947d83a528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:51 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Volume 81790c87-b67a-4028-9a42-42c5af553d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81790c87-b67a-4028-9a42-42c5af553d39', 'volume_size': 1} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Flow 'volume_create_manager' (7344440c-dc5e-442d-9acd-d39e53c0fbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0717deda-13f6-438a-86c6-544867fe7c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0717deda-13f6-438a-86c6-544867fe7c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1659786242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e590b72-3368-43f1-84e2-40e9643c0963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585ed15acc3d4258921a4b800089a73f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:51Z,use_quota=True,user_id='67a60766b88a488b94f661dacaab6b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbe62c0-9566-47e9-82e5-5c3af5110413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbe62c0-9566-47e9-82e5-5c3af5110413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508bbe6c-460a-4244-ab50-9a8812c16ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508bbe6c-460a-4244-ab50-9a8812c16ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e590b72-3368-43f1-84e2-40e9643c0963', 'volume_name': 'volume-4e590b72-3368-43f1-84e2-40e9643c0963', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a73114-9d5f-4a91-86d2-06964d698cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a73114-9d5f-4a91-86d2-06964d698cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401ab686-99cd-4a25-90eb-9fac004c641c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:51 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Volume 4e590b72-3368-43f1-84e2-40e9643c0963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e590b72-3368-43f1-84e2-40e9643c0963', 'volume_size': 1} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:51 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f" returned: 0 in 0.762s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:51 devstack sudo[86159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2 1G Apr 16 13:27:51 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:51 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2 1G" returned: 0 in 0.493s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0a6669a-4376-486e-addd-cfba55f5676f -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:51 devstack sudo[86164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0a6669a-4376-486e-addd-cfba55f5676f -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2 Apr 16 13:27:51 devstack sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:52 devstack sudo[86164]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0a6669a-4376-486e-addd-cfba55f5676f -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2" returned: 0 in 0.460s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:52 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 13:27:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:52 devstack sudo[86169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2 Apr 16 13:27:52 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:52 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2" returned: 0 in 0.446s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:52 devstack sudo[86172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.info Apr 16 13:27:52 devstack sudo[86172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:53 devstack sudo[86172]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.info" returned: 0 in 0.563s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:53 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 13:27:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:53 devstack sudo[86175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.info Apr 16 13:27:53 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:53 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.info" returned: 0 in 0.427s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.210s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.833s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1850351517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81790c87-b67a-4028-9a42-42c5af553d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacf292b569e4d1bbac538d238d01066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:51Z,use_quota=True,user_id='3025b5bc006b4e46b99f9409c6ed6258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:27:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Creating volume 81790c87-b67a-4028-9a42-42c5af553d39 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:27:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:27:53 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:27:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-81790c87-b67a-4028-9a42-42c5af553d39 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:53 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-81790c87-b67a-4028-9a42-42c5af553d39 1073741824 Apr 16 13:27:53 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:53 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-6f4ad24f-0652-4f31-8630-287862b83e3c tempest-GroupSnapshotsV319Test-1355707268 None] group_snapshot 59a8e327-f412-4f56-b578-4124c2d322c1: created successfully Apr 16 13:27:54 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] group_snapshot 59a8e327-f412-4f56-b578-4124c2d322c1: deleting Apr 16 13:27:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] group_snapshot 59a8e327-f412-4f56-b578-4124c2d322c1: deleting {{(pid=83606) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 13:27:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] Acquiring lock "cinder-quobyte-e0a6669a-4376-486e-addd-cfba55f5676f" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] Lock "cinder-quobyte-e0a6669a-4376-486e-addd-cfba55f5676f" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] Acquiring lock "cinder-quobyte-bb00893d-5ab0-4919-8783-6aa4ff85a5f2" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] Lock "cinder-quobyte-bb00893d-5ab0-4919-8783-6aa4ff85a5f2" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:54 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] Deleting offline snapshot bb00893d-5ab0-4919-8783-6aa4ff85a5f2 of volume e0a6669a-4376-486e-addd-cfba55f5676f {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:27:54 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] snapshot_file for this snap is: volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:27:54 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d8eac9-3206-44cf-b46a-c068409bd8bd]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:54 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-81790c87-b67a-4028-9a42-42c5af553d39 1073741824" returned: 0 in 0.577s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-81790c87-b67a-4028-9a42-42c5af553d39 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:54 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2 Apr 16 13:27:54 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:54 devstack sudo[86185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-81790c87-b67a-4028-9a42-42c5af553d39 Apr 16 13:27:54 devstack sudo[86185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:54 devstack sudo[86185]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:54 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-81790c87-b67a-4028-9a42-42c5af553d39" returned: 0 in 0.482s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:54 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:27:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.608s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1659786242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e590b72-3368-43f1-84e2-40e9643c0963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585ed15acc3d4258921a4b800089a73f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:51Z,use_quota=True,user_id='67a60766b88a488b94f661dacaab6b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Creating volume 4e590b72-3368-43f1-84e2-40e9643c0963 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:27:55 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09218288-4458-4bce-a2ab-1947d83a528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81790c87-b67a-4028-9a42-42c5af553d39', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16948ac0-94ef-43c2-989e-479cecd87ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:55 devstack sudo[86192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963 1073741824 Apr 16 13:27:55 devstack sudo[86192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2" returned: 0 in 0.606s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0a6669a-4376-486e-addd-cfba55f5676f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4b736a-043f-4a16-a223-4a004e471131]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:55 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Volume volume-81790c87-b67a-4028-9a42-42c5af553d39 (81790c87-b67a-4028-9a42-42c5af553d39): created successfully Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16948ac0-94ef-43c2-989e-479cecd87ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Flow 'volume_create_manager' (3fa9bb7f-ce7c-4073-a907-194fa43d7e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:55 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-cc9473bb-cde9-4372-849c-57ce408eea06 tempest-VolumesListAdminTestJSON-1804549459 None] Created volume successfully. Apr 16 13:27:55 devstack sudo[86194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f Apr 16 13:27:55 devstack sudo[86194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:55 devstack sudo[86192]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:27:55 devstack sudo[86194]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Flow 'volume_create_manager' (3c1763de-9367-445f-b5e1-f7adc6b9c5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8289d458-df48-4a22-94c1-2f917cb6c710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f" returned: 0 in 0.575s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963 1073741824" returned: 0 in 0.610s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:55 devstack sudo[86203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2 Apr 16 13:27:55 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8289d458-df48-4a22-94c1-2f917cb6c710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-152610037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfea3f75-481a-499d-b65c-dbef2d782a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacf292b569e4d1bbac538d238d01066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:56Z,use_quota=True,user_id='3025b5bc006b4e46b99f9409c6ed6258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36598841-5a5b-48e1-a4ae-e4eb89197d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36598841-5a5b-48e1-a4ae-e4eb89197d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8fa7089-998b-405b-9c3d-31889dcbb325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8fa7089-998b-405b-9c3d-31889dcbb325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfea3f75-481a-499d-b65c-dbef2d782a4c', 'volume_name': 'volume-cfea3f75-481a-499d-b65c-dbef2d782a4c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5807fb7-9afe-403c-8748-0b21ab42e812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5807fb7-9afe-403c-8748-0b21ab42e812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736f1027-e08a-4399-9eb5-ccf4d32515d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:55 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Volume cfea3f75-481a-499d-b65c-dbef2d782a4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfea3f75-481a-499d-b65c-dbef2d782a4c', 'volume_size': 1} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:55 devstack sudo[86205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963 Apr 16 13:27:55 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:56 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2" returned: 0 in 0.485s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:56 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2 Apr 16 13:27:56 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:56 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963" returned: 0 in 0.492s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.502s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-152610037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfea3f75-481a-499d-b65c-dbef2d782a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacf292b569e4d1bbac538d238d01066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:56Z,use_quota=True,user_id='3025b5bc006b4e46b99f9409c6ed6258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Creating volume cfea3f75-481a-499d-b65c-dbef2d782a4c {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:27:56 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfea3f75-481a-499d-b65c-dbef2d782a4c 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401ab686-99cd-4a25-90eb-9fac004c641c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e590b72-3368-43f1-84e2-40e9643c0963', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0e357a-4474-40c0-b7d8-555f0aeaacba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:56 devstack sudo[86213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfea3f75-481a-499d-b65c-dbef2d782a4c 1073741824 Apr 16 13:27:56 devstack sudo[86213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:56 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Volume volume-4e590b72-3368-43f1-84e2-40e9643c0963 (4e590b72-3368-43f1-84e2-40e9643c0963): created successfully Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0e357a-4474-40c0-b7d8-555f0aeaacba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Flow 'volume_create_manager' (7344440c-dc5e-442d-9acd-d39e53c0fbb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:56 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-615099d1-de00-4185-9194-aafcd092c38b tempest-SnapshotsActionsTest-876289904 None] Created volume successfully. Apr 16 13:27:56 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f.bb00893d-5ab0-4919-8783-6aa4ff85a5f2" returned: 0 in 0.468s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] Lock "cinder-quobyte-bb00893d-5ab0-4919-8783-6aa4ff85a5f2" released by "_delete_snapshot" :: held 2.211s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] Lock "cinder-quobyte-e0a6669a-4376-486e-addd-cfba55f5676f" released by "delete_snapshot" :: held 2.227s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:56 devstack cinder-volume[83606]: WARNING cinder.quota [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1263003185 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1263003185, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:27:56 devstack cinder-volume[83606]: WARNING cinder.quota [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1263003185 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1263003185, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] Created reservations ['29fce016-6d0a-4dbb-8e67-f730c22ae704', '5569c1a1-f901-4f17-bc36-7d5d146cb052', '4ea42d3a-8777-480f-a53b-8807d74ef860', 'bf7ffc1b-d14b-42f6-9302-5db7e62e6872'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:56 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-4e2c2c88-6a30-4936-b905-0beef1b4fed4 tempest-GroupSnapshotsV319Test-1355707268 None] group_snapshot 59a8e327-f412-4f56-b578-4124c2d322c1: deleted successfully Apr 16 13:27:56 devstack sudo[86213]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfea3f75-481a-499d-b65c-dbef2d782a4c 1073741824" returned: 0 in 0.595s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfea3f75-481a-499d-b65c-dbef2d782a4c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:56 devstack sudo[86231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfea3f75-481a-499d-b65c-dbef2d782a4c Apr 16 13:27:56 devstack sudo[86231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:57 devstack sudo[86231]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfea3f75-481a-499d-b65c-dbef2d782a4c" returned: 0 in 0.525s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:57 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:27:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.484s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736f1027-e08a-4399-9eb5-ccf4d32515d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfea3f75-481a-499d-b65c-dbef2d782a4c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e454ae-4146-4cfb-afe0-53bbdef4abe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:57 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Volume volume-cfea3f75-481a-499d-b65c-dbef2d782a4c (cfea3f75-481a-499d-b65c-dbef2d782a4c): created successfully Apr 16 13:27:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e454ae-4146-4cfb-afe0-53bbdef4abe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Flow 'volume_create_manager' (3c1763de-9367-445f-b5e1-f7adc6b9c5a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:57 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] Creating offline snapshot ec774f4f-9a08-4f09-a714-f84992733e34 of volume 4e590b72-3368-43f1-84e2-40e9643c0963 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:27:57 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-9fdae3aa-357e-4e57-a1a6-753c5352bf7e tempest-VolumesListAdminTestJSON-1804549459 None] Created volume successfully. Apr 16 13:27:57 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe4c5b0-a531-40eb-9ea2-68b922cd4cb1]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:57 devstack sudo[86252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963 Apr 16 13:27:57 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] Acquiring lock "cinder-quobyte-e0a6669a-4376-486e-addd-cfba55f5676f" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:27:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] Lock "cinder-quobyte-e0a6669a-4376-486e-addd-cfba55f5676f" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:27:57 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[effc2c34-75a1-4f28-b8c1-3f0b84a11791]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:27:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:57 devstack sudo[86254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f Apr 16 13:27:57 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:57 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963" returned: 0 in 0.561s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:57 devstack sudo[86259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 1G Apr 16 13:27:57 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Flow 'volume_create_manager' (df1d1b02-00dd-4223-b3d2-e96fad625542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14439dbc-233f-4ed8-9776-e80571d4e95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14439dbc-233f-4ed8-9776-e80571d4e95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-445720435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a11399d-9157-4406-b458-658e5cf31167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacf292b569e4d1bbac538d238d01066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:58Z,use_quota=True,user_id='3025b5bc006b4e46b99f9409c6ed6258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9988bb47-7628-44ce-93d6-ce5d8f020cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9988bb47-7628-44ce-93d6-ce5d8f020cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a9c50e-5df5-40fa-b579-ff040a2d211b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a9c50e-5df5-40fa-b579-ff040a2d211b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a11399d-9157-4406-b458-658e5cf31167', 'volume_name': 'volume-8a11399d-9157-4406-b458-658e5cf31167', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271f8758-48aa-4ecf-8aa5-5728f6b7e82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271f8758-48aa-4ecf-8aa5-5728f6b7e82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67150cad-38b5-4612-934b-e0722176630d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:27:58 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Volume 8a11399d-9157-4406-b458-658e5cf31167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a11399d-9157-4406-b458-658e5cf31167', 'volume_size': 1} Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:58 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f" returned: 0 in 0.655s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:58 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f Apr 16 13:27:58 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:58 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 1G" returned: 0 in 0.563s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e590b72-3368-43f1-84e2-40e9643c0963 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:58 devstack sudo[86282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e590b72-3368-43f1-84e2-40e9643c0963 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 Apr 16 13:27:58 devstack sudo[86282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:58 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e0a6669a-4376-486e-addd-cfba55f5676f" returned: 0 in 0.413s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] Lock "cinder-quobyte-e0a6669a-4376-486e-addd-cfba55f5676f" released by "delete_volume" :: held 1.106s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] Created reservations ['ec3eefbd-6494-4347-a48d-3cf891b99790'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:58 devstack cinder-volume[83606]: WARNING cinder.quota [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1263003185 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1263003185, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] Created reservations ['04d5dca8-8a11-4c1a-be6d-409c3bfef82f', 'a9250dd0-eff5-4bbb-a391-5d520e73db50', '98eae381-192f-4396-b8c2-7cd8ca63caec', '3098f4ed-a669-4c66-b831-85c66cea8311'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:27:58 devstack sudo[86282]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e590b72-3368-43f1-84e2-40e9643c0963 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34" returned: 0 in 0.468s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:58 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 is being set with open permissions: ugo+rw Apr 16 13:27:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:58 devstack sudo[86296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 Apr 16 13:27:58 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:27:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:27:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:27:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:27:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:27:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:59 devstack sudo[86298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:27:59 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:59 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34" returned: 0 in 0.454s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:59 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:59 devstack sudo[86302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.info Apr 16 13:27:59 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:27:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.434s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:59 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:27:59 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-4275862c-6ab4-42bb-851b-e9cce7e5b31d tempest-GroupSnapshotsV319Test-1355707268 None] Delete group completed successfully. Apr 16 13:27:59 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root Apr 16 13:27:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.info" returned: 0 in 0.435s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:27:59 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.info is being set with open permissions: ugo+rw Apr 16 13:27:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:27:59 devstack sudo[86305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.info Apr 16 13:27:59 devstack sudo[86305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:00 devstack sudo[86305]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.info" returned: 0 in 0.543s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.115s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.381s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-445720435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a11399d-9157-4406-b458-658e5cf31167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacf292b569e4d1bbac538d238d01066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:27:58Z,use_quota=True,user_id='3025b5bc006b4e46b99f9409c6ed6258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:28:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Creating volume 8a11399d-9157-4406-b458-658e5cf31167 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:28:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:28:00 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:28:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8a11399d-9157-4406-b458-658e5cf31167 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:00 devstack sudo[86308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8a11399d-9157-4406-b458-658e5cf31167 1073741824 Apr 16 13:28:00 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:00 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-8d9b3bc0-b81c-4571-b52e-8d31a851f9a7 tempest-SnapshotsActionsTest-876289904 None] Create snapshot completed successfully Apr 16 13:28:01 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8a11399d-9157-4406-b458-658e5cf31167 1073741824" returned: 0 in 0.595s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8a11399d-9157-4406-b458-658e5cf31167 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:01 devstack sudo[86347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8a11399d-9157-4406-b458-658e5cf31167 Apr 16 13:28:01 devstack sudo[86347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7b9925f3-7358-43f4-9ed7-c8edf70d960a tempest-SnapshotsActionsTest-876289904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:01 devstack sudo[86347]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8a11399d-9157-4406-b458-658e5cf31167" returned: 0 in 0.502s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:28:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7b9925f3-7358-43f4-9ed7-c8edf70d960a tempest-SnapshotsActionsTest-876289904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.084s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-7b9925f3-7358-43f4-9ed7-c8edf70d960a tempest-SnapshotsActionsTest-876289904 None] Creating offline snapshot 0a84eab0-3d30-443c-902b-c48dcef17e8f of volume 4e590b72-3368-43f1-84e2-40e9643c0963 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:28:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67150cad-38b5-4612-934b-e0722176630d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a11399d-9157-4406-b458-658e5cf31167', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7656ba8-b52c-4854-a0eb-ff758c245f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:01 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3e35b8-8a96-4c55-83b4-23dfb020d062]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7b9925f3-7358-43f4-9ed7-c8edf70d960a tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:01 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Volume volume-8a11399d-9157-4406-b458-658e5cf31167 (8a11399d-9157-4406-b458-658e5cf31167): created successfully Apr 16 13:28:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7656ba8-b52c-4854-a0eb-ff758c245f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Flow 'volume_create_manager' (df1d1b02-00dd-4223-b3d2-e96fad625542) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:01 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-7634a962-c4a0-4d40-bb57-d0816cb7ab57 tempest-VolumesListAdminTestJSON-1804549459 None] Created volume successfully. Apr 16 13:28:01 devstack sudo[86350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 Apr 16 13:28:01 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:02 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7b9925f3-7358-43f4-9ed7-c8edf70d960a tempest-SnapshotsActionsTest-876289904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34" returned: 0 in 0.553s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-7b9925f3-7358-43f4-9ed7-c8edf70d960a tempest-SnapshotsActionsTest-876289904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e590b72-3368-43f1-84e2-40e9643c0963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:28:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7b9925f3-7358-43f4-9ed7-c8edf70d960a tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:02 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f 1G Apr 16 13:28:02 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:02 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:28:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Flow 'volume_create_manager' (4959d5d9-ee23-4a6d-a8c7-9aef40485e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add966b4-764f-45e3-a6e0-9d88e11b18e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add966b4-764f-45e3-a6e0-9d88e11b18e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9fadf8b-c2fa-4b6e-9746-5e43564e4699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b38e3e30914ec9824c4df2781bcef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:03Z,use_quota=True,user_id='5f8c530a9e4a44cda88c9e81f7e31939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ef454d-c826-4a4a-99c7-7d6a6d0241e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ef454d-c826-4a4a-99c7-7d6a6d0241e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87194e1f-ea0b-458c-a66d-e41e10e24f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87194e1f-ea0b-458c-a66d-e41e10e24f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9fadf8b-c2fa-4b6e-9746-5e43564e4699', 'volume_name': 'volume-e9fadf8b-c2fa-4b6e-9746-5e43564e4699', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30540eb3-ba6e-41bf-bad2-68c3c27707f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30540eb3-ba6e-41bf-bad2-68c3c27707f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc968878-a88f-4231-b776-ebf8f21abc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:02 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Volume e9fadf8b-c2fa-4b6e-9746-5e43564e4699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9fadf8b-c2fa-4b6e-9746-5e43564e4699', 'volume_size': 1} Apr 16 13:28:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:02 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7b9925f3-7358-43f4-9ed7-c8edf70d960a tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f 1G" returned: 0 in 0.645s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7b9925f3-7358-43f4-9ed7-c8edf70d960a tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:02 devstack sudo[86364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f Apr 16 13:28:02 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:03 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7b9925f3-7358-43f4-9ed7-c8edf70d960a tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f" returned: 0 in 0.877s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:03 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-7b9925f3-7358-43f4-9ed7-c8edf70d960a tempest-SnapshotsActionsTest-876289904 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f is being set with open permissions: ugo+rw Apr 16 13:28:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7b9925f3-7358-43f4-9ed7-c8edf70d960a tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:03 devstack sudo[86396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f Apr 16 13:28:03 devstack sudo[86396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:04 devstack sudo[86396]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7b9925f3-7358-43f4-9ed7-c8edf70d960a tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f" returned: 0 in 0.535s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7b9925f3-7358-43f4-9ed7-c8edf70d960a tempest-SnapshotsActionsTest-876289904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.689s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.528s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9fadf8b-c2fa-4b6e-9746-5e43564e4699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b38e3e30914ec9824c4df2781bcef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:03Z,use_quota=True,user_id='5f8c530a9e4a44cda88c9e81f7e31939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Creating volume e9fadf8b-c2fa-4b6e-9746-5e43564e4699 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:28:04 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e9fadf8b-c2fa-4b6e-9746-5e43564e4699 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:04 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-7b9925f3-7358-43f4-9ed7-c8edf70d960a tempest-SnapshotsActionsTest-876289904 None] Create snapshot completed successfully Apr 16 13:28:04 devstack sudo[86399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e9fadf8b-c2fa-4b6e-9746-5e43564e4699 1073741824 Apr 16 13:28:04 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Acquiring lock "cinder-0a84eab0-3d30-443c-902b-c48dcef17e8f-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-0a84eab0-3d30-443c-902b-c48dcef17e8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Acquiring lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" acquired by "delete_snapshot" :: waited 0.033s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Acquiring lock "cinder-quobyte-0a84eab0-3d30-443c-902b-c48dcef17e8f" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-quobyte-0a84eab0-3d30-443c-902b-c48dcef17e8f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Deleting offline snapshot 0a84eab0-3d30-443c-902b-c48dcef17e8f of volume 4e590b72-3368-43f1-84e2-40e9643c0963 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:28:04 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] snapshot_file for this snap is: volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:28:05 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4f22a7-1278-46b9-88ad-e552c1806a86]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:05 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e9fadf8b-c2fa-4b6e-9746-5e43564e4699 1073741824" returned: 0 in 0.727s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e9fadf8b-c2fa-4b6e-9746-5e43564e4699 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:05 devstack sudo[86405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e9fadf8b-c2fa-4b6e-9746-5e43564e4699 Apr 16 13:28:05 devstack sudo[86405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:05 devstack sudo[86404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f Apr 16 13:28:05 devstack sudo[86404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:05 devstack sudo[86405]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e9fadf8b-c2fa-4b6e-9746-5e43564e4699" returned: 0 in 0.493s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:28:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc968878-a88f-4231-b776-ebf8f21abc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9fadf8b-c2fa-4b6e-9746-5e43564e4699', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65193cb1-405f-47be-a7ff-47548d593d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:05 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Volume volume-e9fadf8b-c2fa-4b6e-9746-5e43564e4699 (e9fadf8b-c2fa-4b6e-9746-5e43564e4699): created successfully Apr 16 13:28:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65193cb1-405f-47be-a7ff-47548d593d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Flow 'volume_create_manager' (4959d5d9-ee23-4a6d-a8c7-9aef40485e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:05 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-dbb72805-6461-4df8-b379-056a22133d47 tempest-VolumesListAdminTestJSON-250545404 None] Created volume successfully. Apr 16 13:28:05 devstack sudo[86404]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f" returned: 0 in 0.722s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e590b72-3368-43f1-84e2-40e9643c0963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:28:05 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2771a447-cc72-4138-a4f5-d3376dd3ee96]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:05 devstack sudo[86412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 Apr 16 13:28:05 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] Acquiring lock "cinder-e9fadf8b-c2fa-4b6e-9746-5e43564e4699-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] Lock "cinder-e9fadf8b-c2fa-4b6e-9746-5e43564e4699-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] Acquiring lock "cinder-quobyte-e9fadf8b-c2fa-4b6e-9746-5e43564e4699" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] Lock "cinder-quobyte-e9fadf8b-c2fa-4b6e-9746-5e43564e4699" acquired by "delete_volume" :: waited 0.018s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:06 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ae0edd-a568-4612-a26c-cf27720c5f89]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e9fadf8b-c2fa-4b6e-9746-5e43564e4699 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] Acquiring lock "cinder-8a11399d-9157-4406-b458-658e5cf31167-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "cinder-8a11399d-9157-4406-b458-658e5cf31167-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] Acquiring lock "cinder-quobyte-8a11399d-9157-4406-b458-658e5cf31167" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "cinder-quobyte-8a11399d-9157-4406-b458-658e5cf31167" acquired by "delete_volume" :: waited 0.017s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:06 devstack sudo[86414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e9fadf8b-c2fa-4b6e-9746-5e43564e4699 Apr 16 13:28:06 devstack sudo[86414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:06 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2d93a6-3fa5-4f34-9226-4078e0adc3ae]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8a11399d-9157-4406-b458-658e5cf31167 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:06 devstack sudo[86416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8a11399d-9157-4406-b458-658e5cf31167 Apr 16 13:28:06 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:06 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34" returned: 0 in 0.998s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e590b72-3368-43f1-84e2-40e9643c0963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:28:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:06 devstack sudo[86421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f Apr 16 13:28:06 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:07 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8a11399d-9157-4406-b458-658e5cf31167" returned: 0 in 0.635s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8a11399d-9157-4406-b458-658e5cf31167 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:07 devstack sudo[86453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8a11399d-9157-4406-b458-658e5cf31167 Apr 16 13:28:07 devstack sudo[86453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:07 devstack sudo[86414]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e9fadf8b-c2fa-4b6e-9746-5e43564e4699" returned: 0 in 0.947s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e9fadf8b-c2fa-4b6e-9746-5e43564e4699 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:07 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e9fadf8b-c2fa-4b6e-9746-5e43564e4699 Apr 16 13:28:07 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:07 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f" returned: 0 in 0.936s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:07 devstack sudo[86484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f Apr 16 13:28:07 devstack sudo[86484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:07 devstack sudo[86453]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8a11399d-9157-4406-b458-658e5cf31167" returned: 0 in 0.667s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "cinder-quobyte-8a11399d-9157-4406-b458-658e5cf31167" released by "delete_volume" :: held 1.376s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:07 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e9fadf8b-c2fa-4b6e-9746-5e43564e4699" returned: 0 in 0.708s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] Created reservations ['07bf5feb-6f61-4626-9f9b-0278bacb2ac9', 'c34aeb82-22b5-4ce0-9ffa-f6912687af30', '15c21288-68de-465b-ad62-26d0d931222f', 'c75f5f10-7c8f-484e-ab6d-e9d8da507014'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] Lock "cinder-quobyte-e9fadf8b-c2fa-4b6e-9746-5e43564e4699" released by "delete_volume" :: held 1.713s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:07 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] Created reservations ['963341b9-81ce-426b-bcee-88c9fb981a32', 'a3322413-0635-4826-9b57-f5bd8dccb3a8', 'f31d967c-b389-4308-8f76-0a088d12a185', '958f185e-9bd8-4039-9913-36f3f0e613c2'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:08 devstack sudo[86487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:28:08 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:08 devstack sudo[86489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:28:08 devstack sudo[86489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:08 devstack sudo[86484]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.0a84eab0-3d30-443c-902b-c48dcef17e8f" returned: 0 in 0.613s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-quobyte-0a84eab0-3d30-443c-902b-c48dcef17e8f" released by "_delete_snapshot" :: held 3.331s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" released by "delete_snapshot" :: held 3.350s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Created reservations ['08c46940-6771-492f-a898-35e6381f9b08', 'a0bb9e36-d9b0-436d-838a-bf8816a6ecb3', 'd5d4f783-b8e9-4ce1-9b15-de438fdf2940', '67f9508e-edcd-48c8-b187-cde06411e66d'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:08 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Delete snapshot completed successfully. Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cf18b655-ebcd-44ec-9e0e-45edea56aa53 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-0a84eab0-3d30-443c-902b-c48dcef17e8f-delete_snapshot" released by "delete_snapshot" :: held 3.487s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] Acquiring lock "cinder-cfea3f75-481a-499d-b65c-dbef2d782a4c-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] Lock "cinder-cfea3f75-481a-499d-b65c-dbef2d782a4c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:08 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.856s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] Acquiring lock "cinder-quobyte-cfea3f75-481a-499d-b65c-dbef2d782a4c" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:28:08 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] Deleted volume successfully. Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] Lock "cinder-quobyte-cfea3f75-481a-499d-b65c-dbef2d782a4c" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d1dea6eb-d13b-49fd-96c6-77f392f71934 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "cinder-8a11399d-9157-4406-b458-658e5cf31167-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f29e912-18c5-4b72-b7b4-bd81d953182a]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfea3f75-481a-499d-b65c-dbef2d782a4c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:08 devstack sudo[86516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfea3f75-481a-499d-b65c-dbef2d782a4c Apr 16 13:28:08 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:09 devstack sudo[86489]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 1.108s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:09 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:28:09 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] Deleted volume successfully. Apr 16 13:28:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1d34accf-193c-443d-b935-0fda197956f9 tempest-VolumesListAdminTestJSON-250545404 None] Lock "cinder-e9fadf8b-c2fa-4b6e-9746-5e43564e4699-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-81da749f-f8db-42db-a025-bf38d18a9d43 tempest-SnapshotsActionsTest-876289904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-81da749f-f8db-42db-a025-bf38d18a9d43 tempest-SnapshotsActionsTest-876289904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:09 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfea3f75-481a-499d-b65c-dbef2d782a4c" returned: 0 in 0.525s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfea3f75-481a-499d-b65c-dbef2d782a4c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:09 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-81da749f-f8db-42db-a025-bf38d18a9d43 tempest-SnapshotsActionsTest-876289904 None] Creating offline snapshot 2a1e9720-8ca7-4178-84f4-86202e07f760 of volume 4e590b72-3368-43f1-84e2-40e9643c0963 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:28:09 devstack sudo[86523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfea3f75-481a-499d-b65c-dbef2d782a4c Apr 16 13:28:09 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:09 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ca8edb-fc28-4727-b876-f0c37112249c]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-81da749f-f8db-42db-a025-bf38d18a9d43 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:09 devstack sudo[86525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 Apr 16 13:28:09 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:10 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfea3f75-481a-499d-b65c-dbef2d782a4c" returned: 0 in 0.635s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:10 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] Lock "cinder-quobyte-cfea3f75-481a-499d-b65c-dbef2d782a4c" released by "delete_volume" :: held 1.201s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:10 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] Created reservations ['a41fd8f8-543d-4a17-be3a-4013d1bf52ce', 'bda8cc2f-5ecc-476d-8fd5-a0397176ed9a', '99a4c519-3913-4e3e-b0b7-73d8e6dc072f', '6510f28b-ac12-4680-bb48-9030c3637959'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:10 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-81da749f-f8db-42db-a025-bf38d18a9d43 tempest-SnapshotsActionsTest-876289904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34" returned: 0 in 0.671s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-81da749f-f8db-42db-a025-bf38d18a9d43 tempest-SnapshotsActionsTest-876289904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e590b72-3368-43f1-84e2-40e9643c0963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:28:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-81da749f-f8db-42db-a025-bf38d18a9d43 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:10 devstack sudo[86531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760 1G Apr 16 13:28:10 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:10 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:28:10 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:10 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:10 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.581s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:10 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:28:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-81da749f-f8db-42db-a025-bf38d18a9d43 tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760 1G" returned: 0 in 0.629s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-81da749f-f8db-42db-a025-bf38d18a9d43 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:10 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] Deleted volume successfully. Apr 16 13:28:10 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-89f86ad0-0f38-4c6d-9074-a7fd19fed9ca tempest-VolumesListAdminTestJSON-1804549459 None] Lock "cinder-cfea3f75-481a-499d-b65c-dbef2d782a4c-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:10 devstack sudo[86542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760 Apr 16 13:28:10 devstack sudo[86542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:11 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] Acquiring lock "cinder-81790c87-b67a-4028-9a42-42c5af553d39-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:11 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "cinder-81790c87-b67a-4028-9a42-42c5af553d39-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:11 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] Acquiring lock "cinder-quobyte-81790c87-b67a-4028-9a42-42c5af553d39" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:11 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "cinder-quobyte-81790c87-b67a-4028-9a42-42c5af553d39" acquired by "delete_volume" :: waited 0.017s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:11 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e960bc-8d65-4f87-a795-ea9f103d96d2]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-81790c87-b67a-4028-9a42-42c5af553d39 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:11 devstack sudo[86546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-81790c87-b67a-4028-9a42-42c5af553d39 Apr 16 13:28:11 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:11 devstack sudo[86542]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-81da749f-f8db-42db-a025-bf38d18a9d43 tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760" returned: 0 in 0.543s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:11 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-81da749f-f8db-42db-a025-bf38d18a9d43 tempest-SnapshotsActionsTest-876289904 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760 is being set with open permissions: ugo+rw Apr 16 13:28:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-81da749f-f8db-42db-a025-bf38d18a9d43 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:11 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760 Apr 16 13:28:11 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:11 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-81790c87-b67a-4028-9a42-42c5af553d39" returned: 0 in 0.537s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-81790c87-b67a-4028-9a42-42c5af553d39 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:11 devstack sudo[86555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-81790c87-b67a-4028-9a42-42c5af553d39 Apr 16 13:28:11 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:11 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-81da749f-f8db-42db-a025-bf38d18a9d43 tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760" returned: 0 in 0.527s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-81da749f-f8db-42db-a025-bf38d18a9d43 tempest-SnapshotsActionsTest-876289904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.445s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:11 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-81da749f-f8db-42db-a025-bf38d18a9d43 tempest-SnapshotsActionsTest-876289904 None] Create snapshot completed successfully Apr 16 13:28:12 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-81790c87-b67a-4028-9a42-42c5af553d39" returned: 0 in 0.547s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "cinder-quobyte-81790c87-b67a-4028-9a42-42c5af553d39" released by "delete_volume" :: held 1.106s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] Created reservations ['2edbe3bf-8ba6-43c8-b32b-c7237ad50612', 'a6bdd2e4-82aa-46ee-a26a-b41847c30ef0', '52b85c67-90e7-4fd6-b214-e0d324db0149', '4335fae8-8251-4358-9fc5-d95cd605765e'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Flow 'volume_create_manager' (358d1b65-1edf-4a59-809b-e6e28c2bfc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af05626e-69c2-493d-81b5-d320de971b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af05626e-69c2-493d-81b5-d320de971b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1546015628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15be518c-3bd1-407f-b76c-cf324cdb9576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad3520a1b33445a2b416ae8997d76d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:12Z,use_quota=True,user_id='37964624b1bf4b49843e18b7682f7be7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f04fd8-d54e-4005-b52f-d11b19502b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f04fd8-d54e-4005-b52f-d11b19502b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba741ac4-eba8-4e5f-ad15-49f148bde1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba741ac4-eba8-4e5f-ad15-49f148bde1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15be518c-3bd1-407f-b76c-cf324cdb9576', 'volume_name': 'volume-15be518c-3bd1-407f-b76c-cf324cdb9576', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d5159d-0c90-493e-ae96-fc09b3f41d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d5159d-0c90-493e-ae96-fc09b3f41d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd99309-0573-41b7-b8ec-cf9c6e179374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:12 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Volume 15be518c-3bd1-407f-b76c-cf324cdb9576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15be518c-3bd1-407f-b76c-cf324cdb9576', 'volume_size': 1} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1546015628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15be518c-3bd1-407f-b76c-cf324cdb9576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad3520a1b33445a2b416ae8997d76d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:12Z,use_quota=True,user_id='37964624b1bf4b49843e18b7682f7be7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Creating volume 15be518c-3bd1-407f-b76c-cf324cdb9576 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:28:12 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-15be518c-3bd1-407f-b76c-cf324cdb9576 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:12 devstack sudo[86558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-15be518c-3bd1-407f-b76c-cf324cdb9576 1073741824 Apr 16 13:28:12 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:12 devstack sudo[86560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:28:12 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Acquiring lock "cinder-2a1e9720-8ca7-4178-84f4-86202e07f760-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-2a1e9720-8ca7-4178-84f4-86202e07f760-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Acquiring lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Acquiring lock "cinder-quobyte-2a1e9720-8ca7-4178-84f4-86202e07f760" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-quobyte-2a1e9720-8ca7-4178-84f4-86202e07f760" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Deleting offline snapshot 2a1e9720-8ca7-4178-84f4-86202e07f760 of volume 4e590b72-3368-43f1-84e2-40e9643c0963 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] snapshot_file for this snap is: volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c1fd14-fee2-4feb-88f7-fbe63f463af7]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:12 devstack sudo[86562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760 Apr 16 13:28:12 devstack sudo[86562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:12 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.450s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:28:12 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] Deleted volume successfully. Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-58f097e1-3e93-491c-bf82-67f25071bbc5 tempest-VolumesListAdminTestJSON-1804549459 None] Lock "cinder-81790c87-b67a-4028-9a42-42c5af553d39-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:12 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-15be518c-3bd1-407f-b76c-cf324cdb9576 1073741824" returned: 0 in 0.598s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-15be518c-3bd1-407f-b76c-cf324cdb9576 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:13 devstack sudo[86568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-15be518c-3bd1-407f-b76c-cf324cdb9576 Apr 16 13:28:13 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:13 devstack sudo[86562]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760" returned: 0 in 0.564s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:13 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e590b72-3368-43f1-84e2-40e9643c0963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:28:13 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccec0f1c-fa99-4ec9-9653-33a6437320e7]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:13 devstack sudo[86573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 Apr 16 13:28:13 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:13 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-15be518c-3bd1-407f-b76c-cf324cdb9576" returned: 0 in 0.493s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:13 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:28:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:13 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd99309-0573-41b7-b8ec-cf9c6e179374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15be518c-3bd1-407f-b76c-cf324cdb9576', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:13 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffa6237-d673-44e7-aa7d-87ba6e6b1aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:13 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Volume volume-15be518c-3bd1-407f-b76c-cf324cdb9576 (15be518c-3bd1-407f-b76c-cf324cdb9576): created successfully Apr 16 13:28:13 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffa6237-d673-44e7-aa7d-87ba6e6b1aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:13 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Flow 'volume_create_manager' (358d1b65-1edf-4a59-809b-e6e28c2bfc84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:13 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-a6ade55b-3ce0-491b-92ec-cbe9587b9903 tempest-VolumesServicesTestJSON-254392667 None] Created volume successfully. Apr 16 13:28:13 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34" returned: 0 in 0.476s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:13 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e590b72-3368-43f1-84e2-40e9643c0963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:28:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:13 devstack sudo[86580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760 Apr 16 13:28:13 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:14 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760" returned: 0 in 0.506s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:14 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760 Apr 16 13:28:14 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:14 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] Acquiring lock "cinder-15be518c-3bd1-407f-b76c-cf324cdb9576-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:14 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] Lock "cinder-15be518c-3bd1-407f-b76c-cf324cdb9576-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:14 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] Acquiring lock "cinder-quobyte-15be518c-3bd1-407f-b76c-cf324cdb9576" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:14 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] Lock "cinder-quobyte-15be518c-3bd1-407f-b76c-cf324cdb9576" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:14 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae569a0-98af-4bcf-9bbe-efa75ac168c0]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-15be518c-3bd1-407f-b76c-cf324cdb9576 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:14 devstack sudo[86588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-15be518c-3bd1-407f-b76c-cf324cdb9576 Apr 16 13:28:14 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:14 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.2a1e9720-8ca7-4178-84f4-86202e07f760" returned: 0 in 0.530s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:14 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-quobyte-2a1e9720-8ca7-4178-84f4-86202e07f760" released by "_delete_snapshot" :: held 2.137s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:14 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" released by "delete_snapshot" :: held 2.159s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:14 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Created reservations ['adf7b12c-ba12-4b6c-83cd-d63a470ec75e', '413b9c42-4440-4807-aaf3-c9d2ab026083', 'eb0b9959-e9ba-4298-a050-6f9d465645a3', '8ca3db60-a5d6-4565-9861-611040a7e41a'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:14 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Delete snapshot completed successfully. Apr 16 13:28:14 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-372bf2bc-ce49-464b-9f76-63009191cba6 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-2a1e9720-8ca7-4178-84f4-86202e07f760-delete_snapshot" released by "delete_snapshot" :: held 2.280s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:15 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-15be518c-3bd1-407f-b76c-cf324cdb9576" returned: 0 in 0.615s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-15be518c-3bd1-407f-b76c-cf324cdb9576 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:15 devstack sudo[86593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-15be518c-3bd1-407f-b76c-cf324cdb9576 Apr 16 13:28:15 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:15 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-15be518c-3bd1-407f-b76c-cf324cdb9576" returned: 0 in 0.534s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:15 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] Lock "cinder-quobyte-15be518c-3bd1-407f-b76c-cf324cdb9576" released by "delete_volume" :: held 1.178s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:15 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] Created reservations ['95ddf56a-028a-4f2e-a0e8-f6f72424f57d', 'b9e8f089-5289-4e80-b0b2-63d3718b6f67', 'a56437ec-31f3-43ae-ba08-333a6de8930c', 'c1a782b7-d1b3-45e5-beb4-1f808199c198'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:15 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:28:15 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0f0ebdf2-fc43-4024-b744-046528ee467a tempest-SnapshotsActionsTest-876289904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0f0ebdf2-fc43-4024-b744-046528ee467a tempest-SnapshotsActionsTest-876289904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-0f0ebdf2-fc43-4024-b744-046528ee467a tempest-SnapshotsActionsTest-876289904 None] Creating offline snapshot b16ec835-407a-40db-8510-da3d68720b4e of volume 4e590b72-3368-43f1-84e2-40e9643c0963 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce18b600-d71d-43a9-9329-733738cffeb7]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f0ebdf2-fc43-4024-b744-046528ee467a tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Flow 'volume_create_manager' (3957e626-c259-4baf-8205-54d8723f1c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10ac1b2-5b08-47d8-b7a9-cc0ef6bb84ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10ac1b2-5b08-47d8-b7a9-cc0ef6bb84ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1624721316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fcd85e-3cec-4448-9e72-da3e97983865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6022d21717824fd9869879a9cbb00ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:16Z,use_quota=True,user_id='e19d6539b36c4e1c9e5919773d36133c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40f1eee-8bae-41a6-b6f4-401df7a88799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:16 devstack sudo[86601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 Apr 16 13:28:16 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40f1eee-8bae-41a6-b6f4-401df7a88799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d95d5e-a149-4c4d-865a-053642caf617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d95d5e-a149-4c4d-865a-053642caf617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33fcd85e-3cec-4448-9e72-da3e97983865', 'volume_name': 'volume-33fcd85e-3cec-4448-9e72-da3e97983865', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684e9500-b7c6-41fd-83a8-ac90eff9fbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684e9500-b7c6-41fd-83a8-ac90eff9fbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7a68ab-c22f-4b9e-9700-1e7d29aeeb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:16 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Volume 33fcd85e-3cec-4448-9e72-da3e97983865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33fcd85e-3cec-4448-9e72-da3e97983865', 'volume_size': 1} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:16 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.586s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:28:16 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] Deleted volume successfully. Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:SELECT=207,cinder:UPDATE=211,cinder:DELETE=12,cinder:INSERT=40 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fad68b5b-906a-44c6-8d37-06937766f142 tempest-VolumesServicesTestJSON-254392667 None] Lock "cinder-15be518c-3bd1-407f-b76c-cf324cdb9576-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:16 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f0ebdf2-fc43-4024-b744-046528ee467a tempest-SnapshotsActionsTest-876289904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34" returned: 0 in 0.535s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-0f0ebdf2-fc43-4024-b744-046528ee467a tempest-SnapshotsActionsTest-876289904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e590b72-3368-43f1-84e2-40e9643c0963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:28:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f0ebdf2-fc43-4024-b744-046528ee467a tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:16 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e 1G Apr 16 13:28:16 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:17 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f0ebdf2-fc43-4024-b744-046528ee467a tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e 1G" returned: 0 in 0.568s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f0ebdf2-fc43-4024-b744-046528ee467a tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:17 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e Apr 16 13:28:17 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:17 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f0ebdf2-fc43-4024-b744-046528ee467a tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e" returned: 0 in 0.521s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:17 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-0f0ebdf2-fc43-4024-b744-046528ee467a tempest-SnapshotsActionsTest-876289904 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e is being set with open permissions: ugo+rw Apr 16 13:28:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f0ebdf2-fc43-4024-b744-046528ee467a tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:17 devstack sudo[86632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e Apr 16 13:28:17 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:18 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f0ebdf2-fc43-4024-b744-046528ee467a tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e" returned: 0 in 0.488s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:18 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:UPDATE=199,cinder:SELECT=169,cinder:INSERT=56,cinder:DELETE=12 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:28:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0f0ebdf2-fc43-4024-b744-046528ee467a tempest-SnapshotsActionsTest-876289904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.050s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:18 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1624721316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fcd85e-3cec-4448-9e72-da3e97983865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6022d21717824fd9869879a9cbb00ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:16Z,use_quota=True,user_id='e19d6539b36c4e1c9e5919773d36133c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:28:18 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Creating volume 33fcd85e-3cec-4448-9e72-da3e97983865 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:28:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:18 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:18 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:18 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:28:18 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:28:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:18 devstack sudo[86635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865 1073741824 Apr 16 13:28:18 devstack sudo[86635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:18 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-0f0ebdf2-fc43-4024-b744-046528ee467a tempest-SnapshotsActionsTest-876289904 None] Create snapshot completed successfully Apr 16 13:28:18 devstack sudo[86635]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865 1073741824" returned: 0 in 0.591s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:19 devstack sudo[86640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865 Apr 16 13:28:19 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Acquiring lock "cinder-b16ec835-407a-40db-8510-da3d68720b4e-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-b16ec835-407a-40db-8510-da3d68720b4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Acquiring lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Acquiring lock "cinder-quobyte-b16ec835-407a-40db-8510-da3d68720b4e" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-quobyte-b16ec835-407a-40db-8510-da3d68720b4e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Deleting offline snapshot b16ec835-407a-40db-8510-da3d68720b4e of volume 4e590b72-3368-43f1-84e2-40e9643c0963 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] snapshot_file for this snap is: volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8885d375-3867-4c9b-a64b-88f840502a68]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:19 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e Apr 16 13:28:19 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:19 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865" returned: 0 in 0.508s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7a68ab-c22f-4b9e-9700-1e7d29aeeb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33fcd85e-3cec-4448-9e72-da3e97983865', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c6837b-9c4e-4d70-b9c4-7c3b42613694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:19 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Volume volume-33fcd85e-3cec-4448-9e72-da3e97983865 (33fcd85e-3cec-4448-9e72-da3e97983865): created successfully Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c6837b-9c4e-4d70-b9c4-7c3b42613694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Flow 'volume_create_manager' (3957e626-c259-4baf-8205-54d8723f1c95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:19 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-c519b00e-9dfa-4df2-a60f-a57f04639ffe tempest-SnapshotMetadataTestJSON-79231550 None] Created volume successfully. Apr 16 13:28:19 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e" returned: 0 in 0.572s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e590b72-3368-43f1-84e2-40e9643c0963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5bbfb1-3260-4abc-98eb-75d7bc37ef24]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:20 devstack sudo[86660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 Apr 16 13:28:20 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Flow 'volume_create_manager' (91f6b8cd-fcf7-405b-954a-3515ac85a24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5cb2ee-015d-482d-851c-596394c9baa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5cb2ee-015d-482d-851c-596394c9baa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-650837411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5234f83f-57da-47b9-aadc-10133c1b4219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8f4086f76449459374fd9bc685fd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:20Z,use_quota=True,user_id='e3c4b5feffad4746a608e60e14679125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3d38d6-1a6a-42aa-b2f9-0f5f9528527f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3d38d6-1a6a-42aa-b2f9-0f5f9528527f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f2a571-2c4b-4c2c-8bc1-b8b218bc4ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f2a571-2c4b-4c2c-8bc1-b8b218bc4ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5234f83f-57da-47b9-aadc-10133c1b4219', 'volume_name': 'volume-5234f83f-57da-47b9-aadc-10133c1b4219', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edad8717-48f4-4f55-b050-5e47d05cdce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edad8717-48f4-4f55-b050-5e47d05cdce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31926f4-4fe6-49fa-9d44-0c2418c3ac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:20 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Volume 5234f83f-57da-47b9-aadc-10133c1b4219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5234f83f-57da-47b9-aadc-10133c1b4219', 'volume_size': 1} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-650837411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5234f83f-57da-47b9-aadc-10133c1b4219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8f4086f76449459374fd9bc685fd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:20Z,use_quota=True,user_id='e3c4b5feffad4746a608e60e14679125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Creating volume 5234f83f-57da-47b9-aadc-10133c1b4219 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:28:20 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:20 devstack sudo[86662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219 1073741824 Apr 16 13:28:20 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:20 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34" returned: 0 in 0.572s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e590b72-3368-43f1-84e2-40e9643c0963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:20 devstack sudo[86667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e Apr 16 13:28:20 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:20 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219 1073741824" returned: 0 in 0.530s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:20 devstack sudo[86672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219 Apr 16 13:28:20 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:21 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e" returned: 0 in 0.596s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:21 devstack sudo[86702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e Apr 16 13:28:21 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:21 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219" returned: 0 in 0.653s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.949s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31926f4-4fe6-49fa-9d44-0c2418c3ac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5234f83f-57da-47b9-aadc-10133c1b4219', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a3f9e8-2f62-47b0-ba40-e5dab27e22bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] Creating offline snapshot c6e082b1-d19e-4b7a-8ff5-b393de425239 of volume 33fcd85e-3cec-4448-9e72-da3e97983865 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:28:21 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Volume volume-5234f83f-57da-47b9-aadc-10133c1b4219 (5234f83f-57da-47b9-aadc-10133c1b4219): created successfully Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a3f9e8-2f62-47b0-ba40-e5dab27e22bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Flow 'volume_create_manager' (91f6b8cd-fcf7-405b-954a-3515ac85a24b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b33d11d-137f-4ac7-96ab-4fcc731f002c]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:21 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-3ec8208f-ab7a-42ec-9731-a1712d9926e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Created volume successfully. Apr 16 13:28:21 devstack sudo[86706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865 Apr 16 13:28:21 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:21 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.b16ec835-407a-40db-8510-da3d68720b4e" returned: 0 in 0.604s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-quobyte-b16ec835-407a-40db-8510-da3d68720b4e" released by "_delete_snapshot" :: held 2.434s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" released by "delete_snapshot" :: held 2.448s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Created reservations ['902bb065-f632-4b5d-9c8d-9d2d1de34ca1', '6d4487b6-1148-4340-87dd-a3835b27d6d8', '1a375651-8264-46ad-be90-73647a58a917', 'fc57b051-1a83-4412-8f94-d54ac77fb1d9'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:21 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Delete snapshot completed successfully. Apr 16 13:28:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4b1d8f79-6f76-4c87-85ed-f91a1d3be3f7 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-b16ec835-407a-40db-8510-da3d68720b4e-delete_snapshot" released by "delete_snapshot" :: held 2.538s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:22 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865" returned: 0 in 0.618s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:22 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239 1G Apr 16 13:28:22 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:22 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239 1G" returned: 0 in 0.692s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33fcd85e-3cec-4448-9e72-da3e97983865 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-434f7b8f-0149-4357-972e-59ac3c309970 tempest-SnapshotsActionsTest-876289904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:22 devstack sudo[86718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33fcd85e-3cec-4448-9e72-da3e97983865 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239 Apr 16 13:28:22 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:23 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33fcd85e-3cec-4448-9e72-da3e97983865 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239" returned: 0 in 0.492s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:23 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239 is being set with open permissions: ugo+rw Apr 16 13:28:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:23 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239 Apr 16 13:28:23 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:23 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239" returned: 0 in 0.464s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:23 devstack sudo[86727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.info Apr 16 13:28:23 devstack sudo[86727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:24 devstack sudo[86727]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.info" returned: 0 in 0.444s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:24 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.info is being set with open permissions: ugo+rw Apr 16 13:28:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:24 devstack sudo[86730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.info Apr 16 13:28:24 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:24 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.info" returned: 0 in 0.459s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.286s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.247s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Creating offline snapshot 9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a of volume 5234f83f-57da-47b9-aadc-10133c1b4219 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:28:24 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-90626f93-5339-44e4-8ac6-adc0068e9d0a tempest-SnapshotMetadataTestJSON-79231550 None] Create snapshot completed successfully Apr 16 13:28:24 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7938e963-8074-41c7-a263-dc82619bba23]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:24 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219 Apr 16 13:28:24 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:25 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219" returned: 0 in 0.508s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:25 devstack sudo[86738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a 1G Apr 16 13:28:25 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:25 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a 1G" returned: 0 in 0.520s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5234f83f-57da-47b9-aadc-10133c1b4219 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:25 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5234f83f-57da-47b9-aadc-10133c1b4219 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a Apr 16 13:28:25 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] Acquiring lock "cinder-c6e082b1-d19e-4b7a-8ff5-b393de425239-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] Lock "cinder-c6e082b1-d19e-4b7a-8ff5-b393de425239-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] Acquiring lock "cinder-quobyte-33fcd85e-3cec-4448-9e72-da3e97983865" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] Lock "cinder-quobyte-33fcd85e-3cec-4448-9e72-da3e97983865" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] Acquiring lock "cinder-quobyte-c6e082b1-d19e-4b7a-8ff5-b393de425239" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] Lock "cinder-quobyte-c6e082b1-d19e-4b7a-8ff5-b393de425239" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] Deleting offline snapshot c6e082b1-d19e-4b7a-8ff5-b393de425239 of volume 33fcd85e-3cec-4448-9e72-da3e97983865 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] snapshot_file for this snap is: volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2afa651-2586-442e-8625-7962580a4375]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:26 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5234f83f-57da-47b9-aadc-10133c1b4219 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a" returned: 0 in 0.560s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:26 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a is being set with open permissions: ugo+rw Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:26 devstack sudo[86748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239 Apr 16 13:28:26 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:26 devstack sudo[86750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a Apr 16 13:28:26 devstack sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:26 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239" returned: 0 in 0.529s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33fcd85e-3cec-4448-9e72-da3e97983865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[53688d31-e9ba-4bda-bb95-98544658f684]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:26 devstack sudo[86750]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a" returned: 0 in 0.524s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:26 devstack sudo[86770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865 Apr 16 13:28:26 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:26 devstack sudo[86774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.info Apr 16 13:28:26 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:27 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:27 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.info" returned: 0 in 0.455s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:27 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.info is being set with open permissions: ugo+rw Apr 16 13:28:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865" returned: 0 in 0.530s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:27 devstack sudo[86785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.info Apr 16 13:28:27 devstack sudo[86785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:27 devstack sudo[86786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239 Apr 16 13:28:27 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:27 devstack sudo[86785]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.info" returned: 0 in 0.426s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.078s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-434f7b8f-0149-4357-972e-59ac3c309970 tempest-SnapshotsActionsTest-876289904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.986s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-434f7b8f-0149-4357-972e-59ac3c309970 tempest-SnapshotsActionsTest-876289904 None] Creating offline snapshot 119a352e-885c-40f7-8b01-07c46c9488ae of volume 4e590b72-3368-43f1-84e2-40e9643c0963 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:28:27 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-60be7b78-1e43-449a-8318-d2623c60a719 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Create snapshot completed successfully Apr 16 13:28:27 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e10548-86e3-4c35-9ddb-cb07ac36df79]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-434f7b8f-0149-4357-972e-59ac3c309970 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:27 devstack sudo[86793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 Apr 16 13:28:27 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:28 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239" returned: 0 in 0.599s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:28 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239 Apr 16 13:28:28 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:28 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-434f7b8f-0149-4357-972e-59ac3c309970 tempest-SnapshotsActionsTest-876289904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34" returned: 0 in 0.733s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-434f7b8f-0149-4357-972e-59ac3c309970 tempest-SnapshotsActionsTest-876289904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e590b72-3368-43f1-84e2-40e9643c0963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:28:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-434f7b8f-0149-4357-972e-59ac3c309970 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:28 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae 1G Apr 16 13:28:28 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:28 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865.c6e082b1-d19e-4b7a-8ff5-b393de425239" returned: 0 in 0.659s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] Lock "cinder-quobyte-c6e082b1-d19e-4b7a-8ff5-b393de425239" released by "_delete_snapshot" :: held 2.382s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] Lock "cinder-quobyte-33fcd85e-3cec-4448-9e72-da3e97983865" released by "delete_snapshot" :: held 2.408s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:28 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] Created reservations ['1ad02981-9665-4a7f-9e3e-d97a4a4bd81a', '5a17ef8d-bb67-42e6-899d-c79397ec8123', 'c5c62842-23fb-4408-993d-13a9460a17a1', '1d133c29-91e2-44ae-a51b-875a09a3b97b'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:28 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] Delete snapshot completed successfully. Apr 16 13:28:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-449d17c5-276f-4bf0-966a-fcad90ac8b83 tempest-SnapshotMetadataTestJSON-79231550 None] Lock "cinder-c6e082b1-d19e-4b7a-8ff5-b393de425239-delete_snapshot" released by "delete_snapshot" :: held 2.517s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Acquiring lock "cinder-9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "cinder-9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Acquiring lock "cinder-quobyte-5234f83f-57da-47b9-aadc-10133c1b4219" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "cinder-quobyte-5234f83f-57da-47b9-aadc-10133c1b4219" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Acquiring lock "cinder-quobyte-9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "cinder-quobyte-9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Deleting offline snapshot 9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a of volume 5234f83f-57da-47b9-aadc-10133c1b4219 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] snapshot_file for this snap is: volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d0c5f1-4924-4ba3-87b4-5188255702b0]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:29 devstack sudo[86806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a Apr 16 13:28:29 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:29 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-434f7b8f-0149-4357-972e-59ac3c309970 tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae 1G" returned: 0 in 0.767s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-434f7b8f-0149-4357-972e-59ac3c309970 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:29 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae Apr 16 13:28:29 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] Acquiring lock "cinder-33fcd85e-3cec-4448-9e72-da3e97983865-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] Lock "cinder-33fcd85e-3cec-4448-9e72-da3e97983865-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] Acquiring lock "cinder-quobyte-33fcd85e-3cec-4448-9e72-da3e97983865" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] Lock "cinder-quobyte-33fcd85e-3cec-4448-9e72-da3e97983865" acquired by "delete_volume" :: waited 0.015s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[841e280b-7a5c-41dd-9fe3-638b6fac53ef]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:29 devstack sudo[86811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865 Apr 16 13:28:29 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:30 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a" returned: 0 in 0.835s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5234f83f-57da-47b9-aadc-10133c1b4219(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:28:30 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-434f7b8f-0149-4357-972e-59ac3c309970 tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae" returned: 0 in 0.649s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:30 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-434f7b8f-0149-4357-972e-59ac3c309970 tempest-SnapshotsActionsTest-876289904 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae is being set with open permissions: ugo+rw Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-434f7b8f-0149-4357-972e-59ac3c309970 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a4eadc-8e24-426a-a2af-95a1c55b4cb8]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:30 devstack sudo[86819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae Apr 16 13:28:30 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:30 devstack sudo[86820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219 Apr 16 13:28:30 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:30 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865" returned: 0 in 0.593s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:30 devstack sudo[86826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865 Apr 16 13:28:30 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:30 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-434f7b8f-0149-4357-972e-59ac3c309970 tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae" returned: 0 in 0.460s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-434f7b8f-0149-4357-972e-59ac3c309970 tempest-SnapshotsActionsTest-876289904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:30 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:30 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-434f7b8f-0149-4357-972e-59ac3c309970 tempest-SnapshotsActionsTest-876289904 None] Create snapshot completed successfully Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219" returned: 0 in 0.492s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:30 devstack sudo[86832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a Apr 16 13:28:30 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:30 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-33fcd85e-3cec-4448-9e72-da3e97983865" returned: 0 in 0.470s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] Lock "cinder-quobyte-33fcd85e-3cec-4448-9e72-da3e97983865" released by "delete_volume" :: held 1.163s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] Created reservations ['e6f74be3-93aa-4e8b-aa0b-f55c7a5b1c69', 'e265b7f1-65d1-4002-8865-ec934edb2d53', '84bfb8f5-b78a-465b-b3b1-490992cf7337', '66155178-268e-4fdf-9242-58a6d96074cb'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:30 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:28:30 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:31 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a" returned: 0 in 0.484s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:31 devstack sudo[86840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a Apr 16 13:28:31 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Acquiring lock "cinder-119a352e-885c-40f7-8b01-07c46c9488ae-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-119a352e-885c-40f7-8b01-07c46c9488ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Acquiring lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Acquiring lock "cinder-quobyte-119a352e-885c-40f7-8b01-07c46c9488ae" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-quobyte-119a352e-885c-40f7-8b01-07c46c9488ae" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Deleting offline snapshot 119a352e-885c-40f7-8b01-07c46c9488ae of volume 4e590b72-3368-43f1-84e2-40e9643c0963 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] snapshot_file for this snap is: volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f5a4af-8600-4c98-b309-6f7d53769f8c]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:31 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.513s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:28:31 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] Deleted volume successfully. Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3c8b01f5-bd7d-4a22-83be-67363f26a66e tempest-SnapshotMetadataTestJSON-79231550 None] Lock "cinder-33fcd85e-3cec-4448-9e72-da3e97983865-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:31 devstack sudo[86843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae Apr 16 13:28:31 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:31 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219.9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a" returned: 0 in 0.686s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "cinder-quobyte-9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a" released by "_delete_snapshot" :: held 2.610s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "cinder-quobyte-5234f83f-57da-47b9-aadc-10133c1b4219" released by "delete_snapshot" :: held 2.628s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Created reservations ['8ff18ad0-5fa2-4e3e-bf76-9e131fd63aa4', '2bdf01c9-90b8-474c-b934-f4e2bf8e1bf3', '269ca12c-fb18-4ed2-a5c1-16603357d01e', 'c190d579-1f6d-4da7-8858-4c85c09a6edf'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:31 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Delete snapshot completed successfully. Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1985f318-129d-43d9-b73d-2411f92f2bef tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "cinder-9d5b1f78-ecf1-4b1c-b236-6161b4a56e3a-delete_snapshot" released by "delete_snapshot" :: held 2.740s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:31 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae" returned: 0 in 0.532s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e590b72-3368-43f1-84e2-40e9643c0963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e80712-fc5a-4aa8-8b57-5e651b872977]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:32 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 Apr 16 13:28:32 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Acquiring lock "cinder-5234f83f-57da-47b9-aadc-10133c1b4219-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "cinder-5234f83f-57da-47b9-aadc-10133c1b4219-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Acquiring lock "cinder-quobyte-5234f83f-57da-47b9-aadc-10133c1b4219" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "cinder-quobyte-5234f83f-57da-47b9-aadc-10133c1b4219" acquired by "delete_volume" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:32 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a867e3cb-d1f4-40ff-a4d9-6d64f536df9b]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:32 devstack sudo[86854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219 Apr 16 13:28:32 devstack sudo[86854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:32 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34" returned: 0 in 0.701s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:32 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e590b72-3368-43f1-84e2-40e9643c0963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:28:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:32 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae Apr 16 13:28:32 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:33 devstack sudo[86854]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219" returned: 0 in 0.546s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:33 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219 Apr 16 13:28:33 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:33 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae" returned: 0 in 0.752s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:33 devstack sudo[86869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae Apr 16 13:28:33 devstack sudo[86869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:33 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5234f83f-57da-47b9-aadc-10133c1b4219" returned: 0 in 0.655s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:33 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "cinder-quobyte-5234f83f-57da-47b9-aadc-10133c1b4219" released by "delete_volume" :: held 1.267s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:33 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Created reservations ['cab4e86e-cdd6-4529-a93e-ad1a2eaa8880', '7e44627d-6928-4084-8b12-e65b4ace50a0', '2c2bbbd7-7071-474b-9e26-b753dcb1b3cb', 'c3010098-119c-4ae2-b7a6-48ae1cf8c6f8'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:33 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:33 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:33 devstack sudo[86874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:28:33 devstack sudo[86874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:33 devstack sudo[86869]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.119a352e-885c-40f7-8b01-07c46c9488ae" returned: 0 in 0.529s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:33 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-quobyte-119a352e-885c-40f7-8b01-07c46c9488ae" released by "_delete_snapshot" :: held 2.589s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:33 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" released by "delete_snapshot" :: held 2.606s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Created reservations ['693c2327-4d5d-419b-bad1-e0e55a2460eb', '237e45db-3953-45c2-bee5-6020347760aa', 'f95af3d0-799b-4bbc-ab29-450717199869', '0b2503d7-5e05-4073-be7e-23ec19a20653'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:34 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Delete snapshot completed successfully. Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-861245db-7411-4f42-9977-7f1a6c3eb866 tempest-SnapshotsActionsTest-1722284590 None] Lock "cinder-119a352e-885c-40f7-8b01-07c46c9488ae-delete_snapshot" released by "delete_snapshot" :: held 2.713s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Flow 'volume_create_manager' (b3f20643-8172-4a80-a671-a7cc5af97a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b648d537-5cea-4a2e-95e0-67e71636fc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:34 devstack sudo[86874]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.511s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b648d537-5cea-4a2e-95e0-67e71636fc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-853236811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db047ad8-38da-47ff-8b1d-bc08b487ed1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f64a23da4d495da4f8be1eb6147d51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:34Z,use_quota=True,user_id='4f4c915d5fe94e1d89ffd145e70ea76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa305a91-3ce6-49f1-b7cf-c313e6a6793a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa305a91-3ce6-49f1-b7cf-c313e6a6793a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2f1474-9737-4bcf-be80-ecd9b406bcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2f1474-9737-4bcf-be80-ecd9b406bcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db047ad8-38da-47ff-8b1d-bc08b487ed1b', 'volume_name': 'volume-db047ad8-38da-47ff-8b1d-bc08b487ed1b', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd55d18-8f54-49af-b59c-f06e68b11fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd55d18-8f54-49af-b59c-f06e68b11fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9bcbaa-87eb-4f2b-9a00-8d5ea0332022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:34 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Volume db047ad8-38da-47ff-8b1d-bc08b487ed1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db047ad8-38da-47ff-8b1d-bc08b487ed1b', 'volume_size': 1} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-853236811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db047ad8-38da-47ff-8b1d-bc08b487ed1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f64a23da4d495da4f8be1eb6147d51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:34Z,use_quota=True,user_id='4f4c915d5fe94e1d89ffd145e70ea76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Creating volume db047ad8-38da-47ff-8b1d-bc08b487ed1b {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:28:34 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-db047ad8-38da-47ff-8b1d-bc08b487ed1b 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:34 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Deleted volume successfully. Apr 16 13:28:34 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-db047ad8-38da-47ff-8b1d-bc08b487ed1b 1073741824 Apr 16 13:28:34 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG oslo_service.periodic_task [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83606) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-75abed6f-040d-4522-bb9a-7692fcf91b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079353187 None] Lock "cinder-5234f83f-57da-47b9-aadc-10133c1b4219-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:34 devstack sudo[86880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:28:34 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] Acquiring lock "cinder-ec774f4f-9a08-4f09-a714-f84992733e34-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] Lock "cinder-ec774f4f-9a08-4f09-a714-f84992733e34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] Acquiring lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] Lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] Acquiring lock "cinder-quobyte-ec774f4f-9a08-4f09-a714-f84992733e34" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] Lock "cinder-quobyte-ec774f4f-9a08-4f09-a714-f84992733e34" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] Deleting offline snapshot ec774f4f-9a08-4f09-a714-f84992733e34 of volume 4e590b72-3368-43f1-84e2-40e9643c0963 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:28:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] snapshot_file for this snap is: volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:28:35 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[65037306-0a1b-47b8-9688-bd0f7017ac6c]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:35 devstack sudo[86893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 Apr 16 13:28:35 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:35 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.982s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:35 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:28:35 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-db047ad8-38da-47ff-8b1d-bc08b487ed1b 1073741824" returned: 0 in 1.088s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-db047ad8-38da-47ff-8b1d-bc08b487ed1b {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:35 devstack sudo[86900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-db047ad8-38da-47ff-8b1d-bc08b487ed1b Apr 16 13:28:35 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:35 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34" returned: 0 in 0.800s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e590b72-3368-43f1-84e2-40e9643c0963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:28:35 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[750aee4e-fd38-4b90-a690-aba6d6d8e85d]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:35 devstack sudo[86905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963 Apr 16 13:28:35 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:36 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-db047ad8-38da-47ff-8b1d-bc08b487ed1b" returned: 0 in 0.634s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:28:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9bcbaa-87eb-4f2b-9a00-8d5ea0332022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db047ad8-38da-47ff-8b1d-bc08b487ed1b', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff70859f-8123-4791-ac65-c853f3c9e9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:36 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Volume volume-db047ad8-38da-47ff-8b1d-bc08b487ed1b (db047ad8-38da-47ff-8b1d-bc08b487ed1b): created successfully Apr 16 13:28:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff70859f-8123-4791-ac65-c853f3c9e9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Flow 'volume_create_manager' (b3f20643-8172-4a80-a671-a7cc5af97a7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:36 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-f3f64476-8c82-4cb9-baa1-f61fc88eca6c tempest-VolumesMetadataTest-2054918627 None] Created volume successfully. Apr 16 13:28:36 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963" returned: 0 in 0.617s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:36 devstack sudo[86911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 Apr 16 13:28:36 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:37 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34" returned: 0 in 0.651s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:37 devstack sudo[86916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34 Apr 16 13:28:37 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] Acquiring lock "cinder-db047ad8-38da-47ff-8b1d-bc08b487ed1b-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] Lock "cinder-db047ad8-38da-47ff-8b1d-bc08b487ed1b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] Acquiring lock "cinder-quobyte-db047ad8-38da-47ff-8b1d-bc08b487ed1b" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] Lock "cinder-quobyte-db047ad8-38da-47ff-8b1d-bc08b487ed1b" acquired by "delete_volume" :: waited 0.022s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:37 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[91109566-20fa-4e17-a5d3-de6448699cdb]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-db047ad8-38da-47ff-8b1d-bc08b487ed1b {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:37 devstack sudo[86918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-db047ad8-38da-47ff-8b1d-bc08b487ed1b Apr 16 13:28:37 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:38 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963.ec774f4f-9a08-4f09-a714-f84992733e34" returned: 0 in 0.976s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:38 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] Lock "cinder-quobyte-ec774f4f-9a08-4f09-a714-f84992733e34" released by "_delete_snapshot" :: held 3.152s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:38 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] Lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" released by "delete_snapshot" :: held 3.187s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:38 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] Created reservations ['5f41fbb9-6c7e-4dd6-ab2b-63b88aad158d', 'beebeee0-70e8-4a63-9846-56ec9ce6cc9c', '1daed836-2766-498a-948a-aa621c137ee8', 'd8194ddf-f75b-4c11-b977-dcb5ff1321eb'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:38 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] Delete snapshot completed successfully. Apr 16 13:28:38 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-89b48eff-3303-4ad0-a2c3-aba489b95a60 tempest-SnapshotsActionsTest-876289904 None] Lock "cinder-ec774f4f-9a08-4f09-a714-f84992733e34-delete_snapshot" released by "delete_snapshot" :: held 3.337s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:38 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-db047ad8-38da-47ff-8b1d-bc08b487ed1b" returned: 0 in 0.912s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-db047ad8-38da-47ff-8b1d-bc08b487ed1b {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:38 devstack sudo[86924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-db047ad8-38da-47ff-8b1d-bc08b487ed1b Apr 16 13:28:38 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Flow 'volume_create_manager' (fc5703bf-0573-4541-ae78-4714e0f1c5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0739ba6a-c1b2-47a4-9d60-d3dd31ff98f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0739ba6a-c1b2-47a4-9d60-d3dd31ff98f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:39Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=674849ad-ebb8-4a3f-9c76-21672c11bbe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e85a64a9ea84b27b880e897414a2f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:39Z,use_quota=True,user_id='039e615edc4d4dfdacb1ab734c3897be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46675419-4aac-4e29-8c9a-4b552204a646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46675419-4aac-4e29-8c9a-4b552204a646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61da9c43-a532-4937-b380-fe978b3cbe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.image.glance [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Creating Keystone auth plugin from conf {{(pid=83606) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 13:28:39 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] Acquiring lock "cinder-4e590b72-3368-43f1-84e2-40e9643c0963-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-db047ad8-38da-47ff-8b1d-bc08b487ed1b" returned: 0 in 0.856s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] Lock "cinder-quobyte-db047ad8-38da-47ff-8b1d-bc08b487ed1b" released by "delete_volume" :: held 1.801s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] Lock "cinder-4e590b72-3368-43f1-84e2-40e9643c0963-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] Acquiring lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] Lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" acquired by "delete_volume" :: waited 0.017s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9562828-a295-4f46-abb1-bb533e539b86]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] Created reservations ['5660e479-4167-4bea-b0c7-ad612c97b89d', '3c014e85-11da-4751-b8c1-b63ded27d1d7', 'e2a9039a-75c4-4a4c-8dfe-f5d3ee04f176', 'c533eb69-47ba-486a-bef4-9ed9cc3d298b'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:39 devstack sudo[86929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963 Apr 16 13:28:39 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:39 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:28:39 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61da9c43-a532-4937-b380-fe978b3cbe20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '674849ad-ebb8-4a3f-9c76-21672c11bbe8', 'volume_name': 'volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8', 'volume_size': 1, 'image_id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4eb13d7d316f41debb8154b9017521da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'created_at': datetime.datetime(2026, 4, 16, 11, 21, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 11, 21, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d304ec-4439-4ebb-ad6a-58a6d41edd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d304ec-4439-4ebb-ad6a-58a6d41edd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2696a90-ddd5-4955-9e50-89759872d710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:39 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Volume 674849ad-ebb8-4a3f-9c76-21672c11bbe8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8', 'volume_size': 1, 'image_id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4eb13d7d316f41debb8154b9017521da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'created_at': datetime.datetime(2026, 4, 16, 11, 21, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 11, 21, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 13:28:39 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Trying to clone 674849ad-ebb8-4a3f-9c76-21672c11bbe8 from image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}]). {{(pid=83606) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 13:28:40 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_xt3sytucdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83606) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 13:28:40 devstack cinder-volume[83606]: INFO cinder.image.image_utils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Image download 20.69 MB at 20.69 MB/s Apr 16 13:28:40 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.857s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:40 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:28:40 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] Deleted volume successfully. Apr 16 13:28:40 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ff268b-33e1-449c-891f-ff9add67bcdb]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_xt3sytucdevstack@QuobyteHD {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:40 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0f6e8d85-c9cf-40e8-8c40-0412154e6d1f tempest-VolumesMetadataTest-2054918627 None] Lock "cinder-db047ad8-38da-47ff-8b1d-bc08b487ed1b-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:40 devstack sudo[86956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_xt3sytucdevstack@QuobyteHD Apr 16 13:28:40 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:40 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963" returned: 0 in 1.370s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:40 devstack sudo[86961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963 Apr 16 13:28:40 devstack sudo[86961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:41 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_xt3sytucdevstack@QuobyteHD" returned: 0 in 0.766s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:41 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Temporary image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 is fetched for user 039e615edc4d4dfdacb1ab734c3897be. {{(pid=83606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 13:28:41 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dd11b7-13c0-4511-8658-e716c8b61de2]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_xt3sytucdevstack@QuobyteHD {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:41 devstack sudo[86961]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e590b72-3368-43f1-84e2-40e9643c0963" returned: 0 in 0.837s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:41 devstack sudo[86966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_xt3sytucdevstack@QuobyteHD Apr 16 13:28:41 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:41 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] Lock "cinder-quobyte-4e590b72-3368-43f1-84e2-40e9643c0963" released by "delete_volume" :: held 2.257s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:41 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] Created reservations ['352c9b07-b440-412b-a8d9-3861a2f5d6cb', 'bfda3b8e-28b5-471a-ae01-d5860bda7368', '64088e31-8349-4aa7-b0f7-f21ac0c1d6ea', 'd2ad0979-9eda-48c5-a353-bc38bece2b46'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:41 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:28:41 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:42 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.921s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:42 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:28:42 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] Deleted volume successfully. Apr 16 13:28:42 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_xt3sytucdevstack@QuobyteHD" returned: 0 in 1.327s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:39Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=674849ad-ebb8-4a3f-9c76-21672c11bbe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e85a64a9ea84b27b880e897414a2f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:39Z,use_quota=True,user_id='039e615edc4d4dfdacb1ab734c3897be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:28:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Creating volume 674849ad-ebb8-4a3f-9c76-21672c11bbe8 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:28:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:28:42 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:28:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:42 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-db854738-291f-44d6-bf41-e93b0da0cae6 tempest-SnapshotsActionsTest-876289904 None] Lock "cinder-4e590b72-3368-43f1-84e2-40e9643c0963-delete_volume" released by "delete_volume" :: held 3.428s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:42 devstack sudo[86980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 1073741824 Apr 16 13:28:42 devstack sudo[86980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:44 devstack sudo[86980]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 1073741824" returned: 0 in 1.184s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:44 devstack sudo[87022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 Apr 16 13:28:44 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Flow 'volume_create_manager' (05887339-14f9-4380-8af2-1b5278c4641e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9104bd-3a1e-4299-93b1-3f70794b4eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9104bd-3a1e-4299-93b1-3f70794b4eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-797669790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d690761f-a5a6-4517-bca7-663e284684a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ed89149f9b4138a6197910174c366b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:45Z,use_quota=True,user_id='9489c18ea91841debbe86ba8502eb56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9061c7fb-60b2-4ccf-98fa-b6e13d549f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9061c7fb-60b2-4ccf-98fa-b6e13d549f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bf3a47-efb7-4a3c-a29f-e90fccaf1405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bf3a47-efb7-4a3c-a29f-e90fccaf1405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd690761f-a5a6-4517-bca7-663e284684a6', 'volume_name': 'volume-d690761f-a5a6-4517-bca7-663e284684a6', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8aaff3b-2d42-421f-9e44-86a0a0faec3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8aaff3b-2d42-421f-9e44-86a0a0faec3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee12685f-ba8d-4100-b96b-bdbd220dd383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:44 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Volume d690761f-a5a6-4517-bca7-663e284684a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d690761f-a5a6-4517-bca7-663e284684a6', 'volume_size': 1} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:44 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8" returned: 0 in 0.818s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.103s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-797669790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d690761f-a5a6-4517-bca7-663e284684a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ed89149f9b4138a6197910174c366b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:45Z,use_quota=True,user_id='9489c18ea91841debbe86ba8502eb56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Creating volume d690761f-a5a6-4517-bca7-663e284684a6 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:28:44 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d690761f-a5a6-4517-bca7-663e284684a6 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:44 devstack sudo[87025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d690761f-a5a6-4517-bca7-663e284684a6 1073741824 Apr 16 13:28:44 devstack sudo[87025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG cinder.volume.volume_utils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Attempting download of 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}])) to volume 674849ad-ebb8-4a3f-9c76-21672c11bbe8. {{(pid=83606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7823c8f6-d9e6-4b7c-97e6-4ecb498436d7]: (4, 'raw') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_caszxsvy {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:45 devstack sudo[87027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_caszxsvy Apr 16 13:28:45 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:45 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_caszxsvy" returned: 0 in 0.788s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_caszxsvy {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:45 devstack sudo[87025]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d690761f-a5a6-4517-bca7-663e284684a6 1073741824" returned: 0 in 0.905s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d690761f-a5a6-4517-bca7-663e284684a6 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:45 devstack sudo[87034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_caszxsvy Apr 16 13:28:45 devstack sudo[87034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:45 devstack sudo[87035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d690761f-a5a6-4517-bca7-663e284684a6 Apr 16 13:28:45 devstack sudo[87035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:46 devstack sudo[87035]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d690761f-a5a6-4517-bca7-663e284684a6" returned: 0 in 0.796s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:28:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee12685f-ba8d-4100-b96b-bdbd220dd383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d690761f-a5a6-4517-bca7-663e284684a6', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42915406-4f6a-46e5-8ac7-5bb22e2f465c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:46 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Volume volume-d690761f-a5a6-4517-bca7-663e284684a6 (d690761f-a5a6-4517-bca7-663e284684a6): created successfully Apr 16 13:28:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42915406-4f6a-46e5-8ac7-5bb22e2f465c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Flow 'volume_create_manager' (05887339-14f9-4380-8af2-1b5278c4641e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:46 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-ad001d39-5bf7-4c9f-85bf-7f096a348132 tempest-VolumesTransfersV355Test-1841150868 None] Created volume successfully. Apr 16 13:28:47 devstack sudo[87034]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_caszxsvy" returned: 1 in 1.256s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_caszxsvy' failed. Not Retrying. {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 13:28:47 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c595b82-cad0-4405-8d6b-3d16de58a728]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_xt3sytucdevstack@QuobyteHD {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:47 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_xt3sytucdevstack@QuobyteHD Apr 16 13:28:47 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:47 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_xt3sytucdevstack@QuobyteHD" returned: 0 in 0.701s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:47 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 was qcow2, converting to raw {{(pid=83606) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 13:28:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_xt3sytucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:47 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_xt3sytucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 Apr 16 13:28:47 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:48 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-9be08c32-da62-445b-aae8-6d5e755532dd tempest-VolumesTransfersV355Test-277327197 None] Transfer volume completed successfully. Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Flow 'volume_create_manager' (3f6610c2-69f7-4570-aad3-d6d9d7e85c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e192854f-c37b-4446-97a1-4e5470245f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e192854f-c37b-4446-97a1-4e5470245f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-335498322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0b15ef-5c3d-4c09-b147-1102e9e49c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7e30d57aaa4857ba9fb7c4e7d1daa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:48Z,use_quota=True,user_id='68a8c44e3c0740ae9a411b3440df0e37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbf30938-1cc6-4251-baa2-721a9f798bfb),volume_type_id=bbf30938-1cc6-4251-baa2-721a9f798bfb)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabcd3b4-6a86-439f-b4b2-bf9aae35efa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabcd3b4-6a86-439f-b4b2-bf9aae35efa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a8833cf-c67b-416e-aac6-342572f68fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a8833cf-c67b-416e-aac6-342572f68fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0b15ef-5c3d-4c09-b147-1102e9e49c6f', 'volume_name': 'volume-af0b15ef-5c3d-4c09-b147-1102e9e49c6f', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c910fcbc-a165-4a1d-9868-470998a5d724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c910fcbc-a165-4a1d-9868-470998a5d724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9316a625-f5fe-44b4-994e-44d2ee513f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:48 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Volume af0b15ef-5c3d-4c09-b147-1102e9e49c6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0b15ef-5c3d-4c09-b147-1102e9e49c6f', 'volume_size': 1} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-335498322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0b15ef-5c3d-4c09-b147-1102e9e49c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7e30d57aaa4857ba9fb7c4e7d1daa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:48Z,use_quota=True,user_id='68a8c44e3c0740ae9a411b3440df0e37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbf30938-1cc6-4251-baa2-721a9f798bfb),volume_type_id=bbf30938-1cc6-4251-baa2-721a9f798bfb)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Creating volume af0b15ef-5c3d-4c09-b147-1102e9e49c6f {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:28:48 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-af0b15ef-5c3d-4c09-b147-1102e9e49c6f 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:48 devstack sudo[87054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-af0b15ef-5c3d-4c09-b147-1102e9e49c6f 1073741824 Apr 16 13:28:48 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:48 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_xt3sytucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8" returned: 0 in 1.179s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_xt3sytucdevstack@QuobyteHD, size 112.00 MB, duration 1.18 sec, destination /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:28:48 devstack cinder-volume[83606]: INFO cinder.image.image_utils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Converted 112.00 MB image at 94.90 MB/s Apr 16 13:28:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:48 devstack sudo[87056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 1G Apr 16 13:28:48 devstack sudo[87056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:49 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-af0b15ef-5c3d-4c09-b147-1102e9e49c6f 1073741824" returned: 0 in 0.716s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-af0b15ef-5c3d-4c09-b147-1102e9e49c6f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:49 devstack sudo[87061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-af0b15ef-5c3d-4c09-b147-1102e9e49c6f Apr 16 13:28:49 devstack sudo[87061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] Acquiring lock "cinder-d690761f-a5a6-4517-bca7-663e284684a6-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] Lock "cinder-d690761f-a5a6-4517-bca7-663e284684a6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] Acquiring lock "cinder-quobyte-d690761f-a5a6-4517-bca7-663e284684a6" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] Lock "cinder-quobyte-d690761f-a5a6-4517-bca7-663e284684a6" acquired by "delete_volume" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:49 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[144a6ac6-d519-4e48-a2c8-3fc439b01002]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d690761f-a5a6-4517-bca7-663e284684a6 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:50 devstack sudo[87066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d690761f-a5a6-4517-bca7-663e284684a6 Apr 16 13:28:50 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:50 devstack sudo[87056]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 1G" returned: 0 in 1.127s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:50 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e628467d-6eda-4269-b5ea-ffe2872723a0]: (4, 'raw') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:50 devstack sudo[87068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 Apr 16 13:28:50 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:50 devstack sudo[87061]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-af0b15ef-5c3d-4c09-b147-1102e9e49c6f" returned: 0 in 1.223s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:50 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:28:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:50 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9316a625-f5fe-44b4-994e-44d2ee513f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0b15ef-5c3d-4c09-b147-1102e9e49c6f', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:50 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcec43a7-ff80-4f7e-aca0-bdf1f5087185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:50 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Volume volume-af0b15ef-5c3d-4c09-b147-1102e9e49c6f (af0b15ef-5c3d-4c09-b147-1102e9e49c6f): created successfully Apr 16 13:28:50 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcec43a7-ff80-4f7e-aca0-bdf1f5087185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:50 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Flow 'volume_create_manager' (3f6610c2-69f7-4570-aad3-d6d9d7e85c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:50 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-fb6fd6d8-a35d-4882-b207-dc373da7547d tempest-VolumeTypesAccessTest-854715868 None] Created volume successfully. Apr 16 13:28:50 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8" returned: 0 in 0.713s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:50 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d690761f-a5a6-4517-bca7-663e284684a6" returned: 0 in 1.046s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d690761f-a5a6-4517-bca7-663e284684a6 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:50 devstack sudo[87076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 Apr 16 13:28:50 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:50 devstack sudo[87077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d690761f-a5a6-4517-bca7-663e284684a6 Apr 16 13:28:50 devstack sudo[87077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:51 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8" returned: 1 in 0.531s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8' failed. Not Retrying. {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG cinder.volume.volume_utils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Downloaded image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}])) to volume 674849ad-ebb8-4a3f-9c76-21672c11bbe8 successfully. {{(pid=83606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Temporary image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 for user 039e615edc4d4dfdacb1ab734c3897be is deleted. {{(pid=83606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG cinder.volume.volume_utils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Marking volume 674849ad-ebb8-4a3f-9c76-21672c11bbe8 as bootable. {{(pid=83606) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Copying metadata from image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 to 674849ad-ebb8-4a3f-9c76-21672c11bbe8. {{(pid=83606) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Creating volume glance metadata for volume 674849ad-ebb8-4a3f-9c76-21672c11bbe8 backed by image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83606) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2696a90-ddd5-4955-9e50-89759872d710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8', 'volume_size': 1, 'image_id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4eb13d7d316f41debb8154b9017521da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'created_at': datetime.datetime(2026, 4, 16, 11, 21, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 11, 21, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddde80d3-56a4-43da-a4da-6c6d3959e7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:51 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Volume volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 (674849ad-ebb8-4a3f-9c76-21672c11bbe8): created successfully Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddde80d3-56a4-43da-a4da-6c6d3959e7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Flow 'volume_create_manager' (fc5703bf-0573-4541-ae78-4714e0f1c5b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:51 devstack cinder-volume[83606]: INFO cinder.volume.manager [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-feaaf01b-9630-474a-9df3-f3e11046110b tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Created volume successfully. Apr 16 13:28:51 devstack sudo[87077]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d690761f-a5a6-4517-bca7-663e284684a6" returned: 0 in 0.566s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] Lock "cinder-quobyte-d690761f-a5a6-4517-bca7-663e284684a6" released by "delete_volume" :: held 1.641s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] Created reservations ['d7660447-8272-4404-8b56-bb433bb0d3a1', 'e0a1bb57-1a48-4c3d-bd82-8ea9bf06019d', 'da376d2e-74c9-4611-ae56-36d0ae05b368', '6ce2dbda-58bd-41ca-b52a-b3f1bc6ce702'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:51 devstack sudo[87084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:28:51 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Acquiring lock "cinder-af0b15ef-5c3d-4c09-b147-1102e9e49c6f-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Lock "cinder-af0b15ef-5c3d-4c09-b147-1102e9e49c6f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Acquiring lock "cinder-quobyte-af0b15ef-5c3d-4c09-b147-1102e9e49c6f" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Lock "cinder-quobyte-af0b15ef-5c3d-4c09-b147-1102e9e49c6f" acquired by "delete_volume" :: waited 0.038s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bb274f-b9b4-4c4d-8097-0fccdd6b0346]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-af0b15ef-5c3d-4c09-b147-1102e9e49c6f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-c50cc67d-683f-470f-b8a2-9c957815c9be tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-c50cc67d-683f-470f-b8a2-9c957815c9be tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[28db45cd-8bef-49c1-9ce7-6a0fe3425572]: (4, 'raw') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-c50cc67d-683f-470f-b8a2-9c957815c9be tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:52 devstack sudo[87095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 Apr 16 13:28:52 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:52 devstack sudo[87094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-af0b15ef-5c3d-4c09-b147-1102e9e49c6f Apr 16 13:28:52 devstack sudo[87094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:52 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.846s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:28:52 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] Deleted volume successfully. Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d89bc1e8-a944-4822-9d82-555d7642998f tempest-VolumesTransfersV355Test-1486711893 None] Lock "cinder-d690761f-a5a6-4517-bca7-663e284684a6-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Flow 'volume_create_manager' (986b2188-637c-4924-b8df-fae7e338dac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2aa711-3e1b-48e3-a69c-35a0fc8d44e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2aa711-3e1b-48e3-a69c-35a0fc8d44e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-866031960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c550d72-0ae9-419c-9ee9-0ddfa45e7936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ed89149f9b4138a6197910174c366b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:53Z,use_quota=True,user_id='9489c18ea91841debbe86ba8502eb56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35408848-706d-47de-9eb8-16a820195ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35408848-706d-47de-9eb8-16a820195ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad695f0-f25e-4545-9f04-be344d4762c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad695f0-f25e-4545-9f04-be344d4762c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c550d72-0ae9-419c-9ee9-0ddfa45e7936', 'volume_name': 'volume-5c550d72-0ae9-419c-9ee9-0ddfa45e7936', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632c8a78-d16f-4efb-9ff4-0f5b517449f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632c8a78-d16f-4efb-9ff4-0f5b517449f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c66ff65-5d83-4ea4-b3e6-ecec5ed69ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:52 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Volume 5c550d72-0ae9-419c-9ee9-0ddfa45e7936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c550d72-0ae9-419c-9ee9-0ddfa45e7936', 'volume_size': 1} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:52 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-c50cc67d-683f-470f-b8a2-9c957815c9be tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8" returned: 0 in 0.663s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-c50cc67d-683f-470f-b8a2-9c957815c9be tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:52 devstack sudo[87094]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-af0b15ef-5c3d-4c09-b147-1102e9e49c6f" returned: 0 in 0.761s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-af0b15ef-5c3d-4c09-b147-1102e9e49c6f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:52 devstack sudo[87105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-af0b15ef-5c3d-4c09-b147-1102e9e49c6f Apr 16 13:28:52 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:52 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 Apr 16 13:28:52 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:53 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-c50cc67d-683f-470f-b8a2-9c957815c9be tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8" returned: 1 in 0.591s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-c50cc67d-683f-470f-b8a2-9c957815c9be tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8' failed. Not Retrying. {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-c50cc67d-683f-470f-b8a2-9c957815c9be tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.287s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.704s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-866031960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c550d72-0ae9-419c-9ee9-0ddfa45e7936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ed89149f9b4138a6197910174c366b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:28:53Z,use_quota=True,user_id='9489c18ea91841debbe86ba8502eb56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Creating volume 5c550d72-0ae9-419c-9ee9-0ddfa45e7936 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:28:53 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5c550d72-0ae9-419c-9ee9-0ddfa45e7936 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:53 devstack sudo[87113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5c550d72-0ae9-419c-9ee9-0ddfa45e7936 1073741824 Apr 16 13:28:53 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-c50cc67d-683f-470f-b8a2-9c957815c9be tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912', 'name': 'volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7123aae7-a62c-4911-8efa-87b8f75f9c2c', 'enforce_multipath': True} {{(pid=83606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 13:28:53 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-af0b15ef-5c3d-4c09-b147-1102e9e49c6f" returned: 0 in 0.631s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Lock "cinder-quobyte-af0b15ef-5c3d-4c09-b147-1102e9e49c6f" released by "delete_volume" :: held 1.430s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:53 devstack cinder-volume[83606]: INFO cinder.volume.manager [req-92b285e3-77a6-4531-be3d-ef02f73ead30 req-c50cc67d-683f-470f-b8a2-9c957815c9be tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] attachment_update completed successfully. Apr 16 13:28:53 devstack cinder-volume[83606]: WARNING cinder.quota [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-981158107 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-981158107, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:28:53 devstack cinder-volume[83606]: WARNING cinder.quota [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-981158107 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-981158107, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Created reservations ['6cacd8b5-8d2b-45d2-8f44-8d935cd1b0af', '95e285ec-eefd-43f4-91d4-286ec64fd4d8', '312ad714-3484-42b9-9c57-228499b82187', '98e2ba77-c01e-483e-80e1-e2bfb92820fc'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:53 devstack sudo[87116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:28:53 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:54 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5c550d72-0ae9-419c-9ee9-0ddfa45e7936 1073741824" returned: 0 in 0.634s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5c550d72-0ae9-419c-9ee9-0ddfa45e7936 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:54 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5c550d72-0ae9-419c-9ee9-0ddfa45e7936 Apr 16 13:28:54 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:54 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.517s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:54 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:28:54 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Deleted volume successfully. Apr 16 13:28:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-14397470-0f81-4fbf-a8fd-02734278de98 tempest-VolumeTypesAccessTest-854715868 None] Lock "cinder-af0b15ef-5c3d-4c09-b147-1102e9e49c6f-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:54 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5c550d72-0ae9-419c-9ee9-0ddfa45e7936" returned: 0 in 0.510s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:54 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:28:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c66ff65-5d83-4ea4-b3e6-ecec5ed69ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c550d72-0ae9-419c-9ee9-0ddfa45e7936', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0505a02-b7d3-4b89-ba76-e36692e4407d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:28:54 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Volume volume-5c550d72-0ae9-419c-9ee9-0ddfa45e7936 (5c550d72-0ae9-419c-9ee9-0ddfa45e7936): created successfully Apr 16 13:28:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0505a02-b7d3-4b89-ba76-e36692e4407d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:28:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Flow 'volume_create_manager' (986b2188-637c-4924-b8df-fae7e338dac7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:28:54 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-b48b6668-682b-4cf9-8844-4179fd76959a tempest-VolumesTransfersV355Test-1841150868 None] Created volume successfully. Apr 16 13:28:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] Acquiring lock "cinder-5c550d72-0ae9-419c-9ee9-0ddfa45e7936-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] Lock "cinder-5c550d72-0ae9-419c-9ee9-0ddfa45e7936-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] Acquiring lock "cinder-quobyte-5c550d72-0ae9-419c-9ee9-0ddfa45e7936" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:28:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] Lock "cinder-quobyte-5c550d72-0ae9-419c-9ee9-0ddfa45e7936" acquired by "delete_volume" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:28:55 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a555b720-1424-48bd-bdad-7b9681444d7f]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:28:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5c550d72-0ae9-419c-9ee9-0ddfa45e7936 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:55 devstack sudo[87125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5c550d72-0ae9-419c-9ee9-0ddfa45e7936 Apr 16 13:28:55 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:55 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5c550d72-0ae9-419c-9ee9-0ddfa45e7936" returned: 0 in 0.657s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5c550d72-0ae9-419c-9ee9-0ddfa45e7936 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:55 devstack sudo[87130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5c550d72-0ae9-419c-9ee9-0ddfa45e7936 Apr 16 13:28:55 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:56 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5c550d72-0ae9-419c-9ee9-0ddfa45e7936" returned: 0 in 0.475s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:56 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] Lock "cinder-quobyte-5c550d72-0ae9-419c-9ee9-0ddfa45e7936" released by "delete_volume" :: held 1.179s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:28:56 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] Created reservations ['71bcdae0-f51b-4eb0-a8ed-b9f57e71eab8', '7dc5b058-3d02-452d-bbdb-4f8ab70b9ca3', 'da634138-ee54-4e18-ac27-7590dcd5ed41', 'd292f94b-d1b4-4a01-9181-84a51a643a7f'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:28:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:28:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:28:56 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:28:56 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:28:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:28:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:28:56 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:28:56 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:28:56 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Apr 16 13:28:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.525s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:28:56 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:28:56 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] Deleted volume successfully. Apr 16 13:28:56 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-72f92c87-db4c-43e2-acd5-e03d01ade7fd tempest-VolumesTransfersV355Test-1486711893 None] Lock "cinder-5c550d72-0ae9-419c-9ee9-0ddfa45e7936-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Flow 'volume_create_manager' (41b49662-4ecd-473a-be84-a6695e211e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee444356-4d6b-4562-a25b-d7171ae3133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee444356-4d6b-4562-a25b-d7171ae3133f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1837835015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db20db3-1967-4c99-8d7a-db42621428ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d519f8b2553c40808cf633fd5451ca5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:04Z,use_quota=True,user_id='4501b685d04a4f90a7529b52dd2b98d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f57571-e19e-4087-a116-81d4d8c02118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f57571-e19e-4087-a116-81d4d8c02118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f9e1e1-e923-4906-90ab-773273ae0341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f9e1e1-e923-4906-90ab-773273ae0341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4db20db3-1967-4c99-8d7a-db42621428ad', 'volume_name': 'volume-4db20db3-1967-4c99-8d7a-db42621428ad', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4fdce3-1620-4e74-8d0e-048aa0a91168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4fdce3-1620-4e74-8d0e-048aa0a91168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd23519-54ae-48c6-8696-c92da09ec096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:03 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Volume 4db20db3-1967-4c99-8d7a-db42621428ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4db20db3-1967-4c99-8d7a-db42621428ad', 'volume_size': 1} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1837835015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db20db3-1967-4c99-8d7a-db42621428ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d519f8b2553c40808cf633fd5451ca5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:04Z,use_quota=True,user_id='4501b685d04a4f90a7529b52dd2b98d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Creating volume 4db20db3-1967-4c99-8d7a-db42621428ad {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:29:03 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:29:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:03 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad 1073741824 Apr 16 13:29:03 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:04 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad 1073741824" returned: 0 in 0.956s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:04 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad Apr 16 13:29:04 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:05 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad" returned: 0 in 0.511s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:29:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd23519-54ae-48c6-8696-c92da09ec096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db20db3-1967-4c99-8d7a-db42621428ad', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf9c166-49b0-4632-8b80-13a0c3bc1ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:05 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Volume volume-4db20db3-1967-4c99-8d7a-db42621428ad (4db20db3-1967-4c99-8d7a-db42621428ad): created successfully Apr 16 13:29:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf9c166-49b0-4632-8b80-13a0c3bc1ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Flow 'volume_create_manager' (41b49662-4ecd-473a-be84-a6695e211e39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:05 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-7b031bc1-c7be-4b6c-8b4f-d7085139d25c tempest-VolumesCloneTest-906881227 None] Created volume successfully. Apr 16 13:29:06 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:29:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Flow 'volume_create_manager' (f65d265e-db1e-49ac-910c-64a661a3397c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a808463-9bfe-4d5d-a0cf-0aed0d40e178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a808463-9bfe-4d5d-a0cf-0aed0d40e178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2031507300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d519f8b2553c40808cf633fd5451ca5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4db20db3-1967-4c99-8d7a-db42621428ad,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:06Z,use_quota=True,user_id='4501b685d04a4f90a7529b52dd2b98d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8645c80e-87e5-4785-b1ee-4c5580e88105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8645c80e-87e5-4785-b1ee-4c5580e88105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f001fabf-3a0a-4368-a5ab-6f4d1d4af5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f001fabf-3a0a-4368-a5ab-6f4d1d4af5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f', 'volume_name': 'volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f', 'volume_size': 2, 'source_volid': '4db20db3-1967-4c99-8d7a-db42621428ad', 'source_volstatus': 'available'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6512454-16b3-4a82-b6ac-b841547f94d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6512454-16b3-4a82-b6ac-b841547f94d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (270d93ea-cc5d-4189-8c6c-644a602c556e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:06 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Volume f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f', 'volume_size': 2, 'source_volid': '4db20db3-1967-4c99-8d7a-db42621428ad', 'source_volstatus': 'available'} Apr 16 13:29:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:06 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Cloning volume 4db20db3-1967-4c99-8d7a-db42621428ad to volume f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f Apr 16 13:29:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Creating offline snapshot 8b816a61-e73b-4009-9409-37baa17c3eed of volume 4db20db3-1967-4c99-8d7a-db42621428ad {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:29:06 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecd3d90-86ab-4950-a583-501c4bb74eeb]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:06 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad Apr 16 13:29:06 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:07 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad" returned: 0 in 0.635s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:07 devstack sudo[87245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed 1G Apr 16 13:29:07 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:07 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed 1G" returned: 0 in 0.597s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db20db3-1967-4c99-8d7a-db42621428ad -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:07 devstack sudo[87250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db20db3-1967-4c99-8d7a-db42621428ad -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed Apr 16 13:29:07 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:08 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db20db3-1967-4c99-8d7a-db42621428ad -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed" returned: 0 in 0.518s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:08 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed is being set with open permissions: ugo+rw Apr 16 13:29:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:08 devstack sudo[87255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed Apr 16 13:29:08 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:08 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed" returned: 0 in 0.458s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:08 devstack sudo[87277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.info Apr 16 13:29:08 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:09 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.info" returned: 0 in 0.476s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:09 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.info is being set with open permissions: ugo+rw Apr 16 13:29:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:09 devstack sudo[87280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.info Apr 16 13:29:09 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:09 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.info" returned: 0 in 0.633s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Acquiring lock "cinder-quobyte-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f" by "_copy_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Lock "cinder-quobyte-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:09 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] snapshot: 8b816a61-e73b-4009-9409-37baa17c3eed, volume: f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f, {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 13:29:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:09 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:09 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:09 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35d80ec-d4e1-43f1-9ca8-5e1e7406a6cf]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:09 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed Apr 16 13:29:09 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:10 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed" returned: 0 in 0.657s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4db20db3-1967-4c99-8d7a-db42621428ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:29:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 13:29:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Creating direct copy from snapshot {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 13:29:10 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f483daf6-c51e-4edb-9f2e-9046fcffcd0b]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:10 devstack sudo[87290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad Apr 16 13:29:10 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:11 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad" returned: 0 in 0.630s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:11 devstack cinder-volume[83606]: DEBUG cinder.utils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Path /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f not found in is_blk_device check {{(pid=83606) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 13:29:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:11 devstack sudo[87295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f Apr 16 13:29:11 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:14 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f" returned: 0 in 3.114s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:14 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d35a5e8-fb0b-421b-8395-44318e27fcb0]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:14 devstack sudo[87352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad Apr 16 13:29:14 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:14 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:29:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Flow 'volume_create_manager' (5710bc8e-a91a-4caa-90a5-68585692cf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c194e9e4-0aa0-4bd8-9123-a770ab9939f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c194e9e4-0aa0-4bd8-9123-a770ab9939f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-938315631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b84a59-3c56-48ce-8e05-9d4e07be4436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47e8898c49f4c2298ca5424c1fe91fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:15Z,use_quota=True,user_id='6b2476e24b4541db81b9d053e95969f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3a380c-1506-4ac5-84c5-eec573ee01b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3a380c-1506-4ac5-84c5-eec573ee01b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6938208f-012d-44d0-af55-69ad588d212c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6938208f-012d-44d0-af55-69ad588d212c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35b84a59-3c56-48ce-8e05-9d4e07be4436', 'volume_name': 'volume-35b84a59-3c56-48ce-8e05-9d4e07be4436', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33865502-4a94-46d8-bf02-61df301d7903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33865502-4a94-46d8-bf02-61df301d7903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb0b632-0531-4442-8fdf-a1126a618ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:14 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Volume 35b84a59-3c56-48ce-8e05-9d4e07be4436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35b84a59-3c56-48ce-8e05-9d4e07be4436', 'volume_size': 1} Apr 16 13:29:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:15 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad" returned: 0 in 0.826s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:15 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Image conversion details: src /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad, size 1024.00 MB, duration 3.12 sec, destination /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:29:15 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Converted 1024.00 MB image at 328.59 MB/s Apr 16 13:29:15 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f is being set with open permissions: ugo+rw Apr 16 13:29:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:15 devstack sudo[87358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f Apr 16 13:29:15 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:15 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f" returned: 0 in 0.486s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:15 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Lock "cinder-quobyte-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f" released by "_copy_volume_from_snapshot" :: held 5.782s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:15 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Acquiring lock "cinder-quobyte-8b816a61-e73b-4009-9409-37baa17c3eed" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:15 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Lock "cinder-quobyte-8b816a61-e73b-4009-9409-37baa17c3eed" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Deleting offline snapshot 8b816a61-e73b-4009-9409-37baa17c3eed of volume 4db20db3-1967-4c99-8d7a-db42621428ad {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:29:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] snapshot_file for this snap is: volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:29:15 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e17c20-f469-41a4-aeb2-bc76617687e1]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:15 devstack sudo[87364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed Apr 16 13:29:15 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:16 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed" returned: 0 in 0.515s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:16 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4db20db3-1967-4c99-8d7a-db42621428ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:29:16 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[55222d7e-dc78-4a41-9847-9c706d80d629]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:16 devstack sudo[87369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad Apr 16 13:29:16 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:16 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad" returned: 0 in 0.486s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:16 devstack sudo[87374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed Apr 16 13:29:16 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:17 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed" returned: 0 in 0.519s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:17 devstack sudo[87381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed Apr 16 13:29:17 devstack sudo[87381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:17 devstack sudo[87381]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad.8b816a61-e73b-4009-9409-37baa17c3eed" returned: 0 in 0.559s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Lock "cinder-quobyte-8b816a61-e73b-4009-9409-37baa17c3eed" released by "_delete_snapshot" :: held 2.174s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:SELECT=100,cinder:UPDATE=103,cinder:DELETE=8,cinder:INSERT=37 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.473s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.111s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-938315631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b84a59-3c56-48ce-8e05-9d4e07be4436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47e8898c49f4c2298ca5424c1fe91fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:15Z,use_quota=True,user_id='6b2476e24b4541db81b9d053e95969f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Creating volume 35b84a59-3c56-48ce-8e05-9d4e07be4436 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:29:17 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (270d93ea-cc5d-4189-8c6c-644a602c556e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f', 'volume_size': 2, 'source_volid': '4db20db3-1967-4c99-8d7a-db42621428ad', 'source_volstatus': 'available'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94ae4bd-f087-4b1c-b292-e46e7487d220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:17 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436 1073741824 Apr 16 13:29:17 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:17 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Volume volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f (f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f): created successfully Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94ae4bd-f087-4b1c-b292-e46e7487d220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:17 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Flow 'volume_create_manager' (f65d265e-db1e-49ac-910c-64a661a3397c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:17 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-98195bdb-c039-4766-bcbb-c3867718566a tempest-VolumesCloneTest-906881227 None] Created volume successfully. Apr 16 13:29:18 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436 1073741824" returned: 0 in 0.863s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:18 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:SELECT=112,cinder:UPDATE=133,cinder:INSERT=37,cinder:DELETE=11 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:29:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:18 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436 Apr 16 13:29:18 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] Acquiring lock "cinder-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] Lock "cinder-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] Acquiring lock "cinder-quobyte-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] Lock "cinder-quobyte-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f" acquired by "delete_volume" :: waited 0.014s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:19 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8576e67f-ffae-46bd-bec5-0a9ead519906]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:19 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436" returned: 0 in 0.886s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:19 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:29:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:19 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f Apr 16 13:29:19 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb0b632-0531-4442-8fdf-a1126a618ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35b84a59-3c56-48ce-8e05-9d4e07be4436', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd3da0f-5395-4044-b645-55659c7ef128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:19 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Volume volume-35b84a59-3c56-48ce-8e05-9d4e07be4436 (35b84a59-3c56-48ce-8e05-9d4e07be4436): created successfully Apr 16 13:29:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd3da0f-5395-4044-b645-55659c7ef128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Flow 'volume_create_manager' (5710bc8e-a91a-4caa-90a5-68585692cf21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:19 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d4728689-97f8-49f6-864e-da85f99631dd tempest-VolumesDeleteCascade-657526560 None] Created volume successfully. Apr 16 13:29:20 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:29:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Flow 'volume_create_manager' (f2ac8490-dbbc-4131-a248-018ed4a25410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c962d0-249e-4358-83f8-1aff6b25f8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c962d0-249e-4358-83f8-1aff6b25f8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-570546932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93da9f36-c842-4185-a380-30956cd11104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c23133ff0440eb963eda67e43720d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:21Z,use_quota=True,user_id='1f3ac2402b2a4adf855a10612ae6fff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286d8495-cb77-45e8-98c7-633a92d0f9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286d8495-cb77-45e8-98c7-633a92d0f9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef1abd3-ae49-476a-acf8-2cfbe40465d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef1abd3-ae49-476a-acf8-2cfbe40465d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93da9f36-c842-4185-a380-30956cd11104', 'volume_name': 'volume-93da9f36-c842-4185-a380-30956cd11104', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6956469-fecb-499b-aef4-0112647fb5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6956469-fecb-499b-aef4-0112647fb5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c863f8db-53cd-485b-8b82-7ad410b2da9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:20 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Volume 93da9f36-c842-4185-a380-30956cd11104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93da9f36-c842-4185-a380-30956cd11104', 'volume_size': 1} Apr 16 13:29:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] Creating offline snapshot 64f54519-59d6-4614-97b2-54eda67005af of volume 35b84a59-3c56-48ce-8e05-9d4e07be4436 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:29:20 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0040ec-1911-46c0-a89e-36a154d63a94]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:21 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f" returned: 0 in 1.664s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:21 devstack sudo[87466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436 Apr 16 13:29:21 devstack sudo[87466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:21 devstack sudo[87467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f Apr 16 13:29:21 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:21 devstack sudo[87466]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436" returned: 0 in 0.917s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:21 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f" returned: 0 in 0.749s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:21 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af 1G Apr 16 13:29:21 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] Lock "cinder-quobyte-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f" released by "delete_volume" :: held 2.474s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:21 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] Created reservations ['f1eb615e-2512-45fd-8eaf-6a4903dcf5d7', '732f8ee9-e613-458a-855f-9c605bcd5f4f', '3876c57d-8c13-4d13-b980-6b56908be18a', '04335a79-f57e-4c09-b894-effa71196610'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:29:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:22 devstack sudo[87476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:29:22 devstack sudo[87476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:22 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af 1G" returned: 0 in 0.609s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35b84a59-3c56-48ce-8e05-9d4e07be4436 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:22 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35b84a59-3c56-48ce-8e05-9d4e07be4436 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af Apr 16 13:29:22 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:22 devstack sudo[87476]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.582s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:22 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:29:22 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] Deleted volume successfully. Apr 16 13:29:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a9e35044-7455-4e60-9405-bb60fa85cd64 tempest-VolumesCloneTest-906881227 None] Lock "cinder-f77a7fa2-0499-4bcf-bd8a-f3f545f98c1f-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] Acquiring lock "cinder-4db20db3-1967-4c99-8d7a-db42621428ad-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] Lock "cinder-4db20db3-1967-4c99-8d7a-db42621428ad-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] Acquiring lock "cinder-quobyte-4db20db3-1967-4c99-8d7a-db42621428ad" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] Lock "cinder-quobyte-4db20db3-1967-4c99-8d7a-db42621428ad" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:22 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4bb2ed-364e-44d2-b537-c422db63b9df]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:23 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad Apr 16 13:29:23 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:23 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35b84a59-3c56-48ce-8e05-9d4e07be4436 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af" returned: 0 in 0.669s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:23 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af is being set with open permissions: ugo+rw Apr 16 13:29:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:23 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af Apr 16 13:29:23 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:23 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad" returned: 0 in 0.532s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:23 devstack sudo[87516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad Apr 16 13:29:23 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:23 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af" returned: 0 in 0.455s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:23 devstack sudo[87520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.info Apr 16 13:29:23 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:23 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4db20db3-1967-4c99-8d7a-db42621428ad" returned: 0 in 0.458s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] Lock "cinder-quobyte-4db20db3-1967-4c99-8d7a-db42621428ad" released by "delete_volume" :: held 1.055s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] Created reservations ['e11bd11a-3b46-46a9-aaf0-4f7e9e507875', '6a0ec657-e17d-4f42-84ef-deb621642b6d', 'c26a3584-2c97-4961-bdbf-f51ea9049c80', '70e492b8-2872-4d36-bc09-43deca4a975d'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:24 devstack sudo[87523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:29:24 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:24 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.info" returned: 0 in 0.653s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:24 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.info is being set with open permissions: ugo+rw Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:24 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.info Apr 16 13:29:24 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:24 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.460s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:29:24 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] Deleted volume successfully. Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fcc01f6c-c2b1-41ed-9b0a-04b1891e69be tempest-VolumesCloneTest-906881227 None] Lock "cinder-4db20db3-1967-4c99-8d7a-db42621428ad-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:24 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.info" returned: 0 in 0.438s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.936s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.871s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-570546932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93da9f36-c842-4185-a380-30956cd11104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c23133ff0440eb963eda67e43720d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:21Z,use_quota=True,user_id='1f3ac2402b2a4adf855a10612ae6fff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Creating volume 93da9f36-c842-4185-a380-30956cd11104 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:29:24 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:29:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-93da9f36-c842-4185-a380-30956cd11104 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:24 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-177204c8-60f1-4b2e-b90f-ec67541b74c6 tempest-VolumesDeleteCascade-657526560 None] Create snapshot completed successfully Apr 16 13:29:24 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-93da9f36-c842-4185-a380-30956cd11104 1073741824 Apr 16 13:29:24 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:25 devstack cinder-volume[83606]: INFO cinder.volume.manager [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-08ce858c-c6f2-45a0-b6bc-64edadcdd923 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Terminate volume connection completed successfully. Apr 16 13:29:25 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-08ce858c-c6f2-45a0-b6bc-64edadcdd923 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Deleting attachment 7123aae7-a62c-4911-8efa-87b8f75f9c2c. {{(pid=83606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 13:29:25 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-93da9f36-c842-4185-a380-30956cd11104 1073741824" returned: 0 in 0.570s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-93da9f36-c842-4185-a380-30956cd11104 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:25 devstack sudo[87536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-93da9f36-c842-4185-a380-30956cd11104 Apr 16 13:29:25 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:25 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Acquiring lock "cinder-674849ad-ebb8-4a3f-9c76-21672c11bbe8-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:25 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "cinder-674849ad-ebb8-4a3f-9c76-21672c11bbe8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:25 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Acquiring lock "cinder-quobyte-674849ad-ebb8-4a3f-9c76-21672c11bbe8" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:25 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "cinder-quobyte-674849ad-ebb8-4a3f-9c76-21672c11bbe8" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:25 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[98775e0a-2778-472e-987b-1e2134044e53]: (4, 'raw') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:26 devstack sudo[87539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 Apr 16 13:29:26 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:26 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-93da9f36-c842-4185-a380-30956cd11104" returned: 0 in 0.750s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:29:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c863f8db-53cd-485b-8b82-7ad410b2da9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93da9f36-c842-4185-a380-30956cd11104', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a11f55-5593-494d-8a80-9dd7378f47a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:26 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Volume volume-93da9f36-c842-4185-a380-30956cd11104 (93da9f36-c842-4185-a380-30956cd11104): created successfully Apr 16 13:29:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a11f55-5593-494d-8a80-9dd7378f47a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Flow 'volume_create_manager' (f2ac8490-dbbc-4131-a248-018ed4a25410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-12ca67f2-89ba-42d3-9e70-2b1f8d520432 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-12ca67f2-89ba-42d3-9e70-2b1f8d520432 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-12ca67f2-89ba-42d3-9e70-2b1f8d520432 tempest-VolumesDeleteCascade-657526560 None] Creating offline snapshot 14a7af26-d304-4074-af57-e983439eb78a of volume 35b84a59-3c56-48ce-8e05-9d4e07be4436 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:29:26 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d5f26f85-0225-4fb9-bce0-fa6a10cf6600 tempest-VolumesActionsTest-444196845 None] Created volume successfully. Apr 16 13:29:26 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df22082-ab02-48b6-8b76-f958a76c7e7a]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-12ca67f2-89ba-42d3-9e70-2b1f8d520432 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:26 devstack sudo[87541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af Apr 16 13:29:26 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:26 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8" returned: 0 in 0.647s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:26 devstack sudo[87545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 Apr 16 13:29:26 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:26 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-12ca67f2-89ba-42d3-9e70-2b1f8d520432 tempest-VolumesDeleteCascade-657526560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af" returned: 0 in 0.698s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-12ca67f2-89ba-42d3-9e70-2b1f8d520432 tempest-VolumesDeleteCascade-657526560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35b84a59-3c56-48ce-8e05-9d4e07be4436(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:29:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-12ca67f2-89ba-42d3-9e70-2b1f8d520432 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:27 devstack sudo[87550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a 1G Apr 16 13:29:27 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-478d9605-fafd-413d-9e30-89839ce22774 tempest-VolumesActionsTest-444196845 None] Acquiring lock "cinder-93da9f36-c842-4185-a380-30956cd11104" by "attach_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Flow 'volume_create_manager' (5f1d3dac-3f84-4945-9cf6-f5bc3f24b4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79344401-74c6-437b-9e1d-fba4888d9447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79344401-74c6-437b-9e1d-fba4888d9447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-423355233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5822d813-fb10-49a7-b2f8-f294c706b729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d810eb1469647f58dacf61bcfd3cd53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:27Z,use_quota=True,user_id='e811bae919b14e20bbb10124527c43e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed2cb84-0cb7-4735-ad2f-3f028d4246b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed2cb84-0cb7-4735-ad2f-3f028d4246b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0384ca-f27c-408d-a7a9-d4025f15cd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0384ca-f27c-408d-a7a9-d4025f15cd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5822d813-fb10-49a7-b2f8-f294c706b729', 'volume_name': 'volume-5822d813-fb10-49a7-b2f8-f294c706b729', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c923376-e91c-4562-861b-fa83ef968818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c923376-e91c-4562-861b-fa83ef968818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2ae107-868a-41d1-9dcf-6a54dc3262eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:27 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Volume 5822d813-fb10-49a7-b2f8-f294c706b729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5822d813-fb10-49a7-b2f8-f294c706b729', 'volume_size': 1} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-478d9605-fafd-413d-9e30-89839ce22774 tempest-VolumesActionsTest-444196845 None] Lock "cinder-93da9f36-c842-4185-a380-30956cd11104" acquired by "attach_volume" :: waited 0.090s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:27 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8" returned: 1 in 0.631s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8' failed. Not Retrying. {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:27 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8 Apr 16 13:29:27 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:27 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-478d9605-fafd-413d-9e30-89839ce22774 tempest-VolumesActionsTest-444196845 None] Attaching volume 93da9f36-c842-4185-a380-30956cd11104 to instance db957a79-78a1-469c-954f-e8a18c9885a7 at mountpoint /dev/vdb on host None. Apr 16 13:29:27 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-478d9605-fafd-413d-9e30-89839ce22774 tempest-VolumesActionsTest-444196845 None] Attach volume completed successfully. Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-478d9605-fafd-413d-9e30-89839ce22774 tempest-VolumesActionsTest-444196845 None] Lock "cinder-93da9f36-c842-4185-a380-30956cd11104" released by "attach_volume" :: held 0.088s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:27 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-12ca67f2-89ba-42d3-9e70-2b1f8d520432 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a 1G" returned: 0 in 0.666s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-12ca67f2-89ba-42d3-9e70-2b1f8d520432 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:27 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a Apr 16 13:29:27 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:27 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-674849ad-ebb8-4a3f-9c76-21672c11bbe8" returned: 0 in 0.536s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "cinder-quobyte-674849ad-ebb8-4a3f-9c76-21672c11bbe8" released by "delete_volume" :: held 1.884s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.quota [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Created reservations ['a7d32eb9-b66f-419a-be45-077357592e93', 'b26c1090-d0c6-478a-9346-36b0fcde711c', '96355d7a-0855-4e83-9656-d0102d1c5cdb', '474c25cc-e4a3-4023-b25b-daf5545536f3'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:27 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:29:27 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:28 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-1fab0b38-2286-4ec8-8330-0636f1c48d33 tempest-VolumesActionsTest-1792347583 None] Terminate volume connection completed successfully. Apr 16 13:29:28 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-12ca67f2-89ba-42d3-9e70-2b1f8d520432 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a" returned: 0 in 0.584s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:28 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-12ca67f2-89ba-42d3-9e70-2b1f8d520432 tempest-VolumesDeleteCascade-657526560 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a is being set with open permissions: ugo+rw Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-12ca67f2-89ba-42d3-9e70-2b1f8d520432 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:28 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a Apr 16 13:29:28 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:28 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.459s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG cinder.manager [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:29:28 devstack cinder-volume[83606]: INFO cinder.volume.manager [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Deleted volume successfully. Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-dee89974-26fc-45dd-a9a5-5529d442a48a req-88bbbd48-aeac-44bf-90d2-360a165369f4 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "cinder-674849ad-ebb8-4a3f-9c76-21672c11bbe8-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1fab0b38-2286-4ec8-8330-0636f1c48d33 tempest-VolumesActionsTest-1792347583 None] Acquiring lock "cinder-93da9f36-c842-4185-a380-30956cd11104-detach_volume" by "detach_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1fab0b38-2286-4ec8-8330-0636f1c48d33 tempest-VolumesActionsTest-1792347583 None] Lock "cinder-93da9f36-c842-4185-a380-30956cd11104-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:28 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-1fab0b38-2286-4ec8-8330-0636f1c48d33 tempest-VolumesActionsTest-1792347583 None] Detaching volume 93da9f36-c842-4185-a380-30956cd11104 from instance db957a79-78a1-469c-954f-e8a18c9885a7. Apr 16 13:29:28 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-1fab0b38-2286-4ec8-8330-0636f1c48d33 tempest-VolumesActionsTest-1792347583 None] Detach volume completed successfully. Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1fab0b38-2286-4ec8-8330-0636f1c48d33 tempest-VolumesActionsTest-1792347583 None] Lock "cinder-93da9f36-c842-4185-a380-30956cd11104-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:28 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-12ca67f2-89ba-42d3-9e70-2b1f8d520432 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a" returned: 0 in 0.465s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-12ca67f2-89ba-42d3-9e70-2b1f8d520432 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.473s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.484s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-423355233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5822d813-fb10-49a7-b2f8-f294c706b729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d810eb1469647f58dacf61bcfd3cd53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:27Z,use_quota=True,user_id='e811bae919b14e20bbb10124527c43e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Creating volume 5822d813-fb10-49a7-b2f8-f294c706b729 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:29:28 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:29:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5822d813-fb10-49a7-b2f8-f294c706b729 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:28 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-12ca67f2-89ba-42d3-9e70-2b1f8d520432 tempest-VolumesDeleteCascade-657526560 None] Create snapshot completed successfully Apr 16 13:29:28 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5822d813-fb10-49a7-b2f8-f294c706b729 1073741824 Apr 16 13:29:28 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9f60c05d-3085-4956-8b9b-c44f6187c409 tempest-VolumesActionsTest-444196845 None] Acquiring lock "cinder-93da9f36-c842-4185-a380-30956cd11104-detach_volume" by "detach_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9f60c05d-3085-4956-8b9b-c44f6187c409 tempest-VolumesActionsTest-444196845 None] Lock "cinder-93da9f36-c842-4185-a380-30956cd11104-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:29 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-9f60c05d-3085-4956-8b9b-c44f6187c409 tempest-VolumesActionsTest-444196845 None] Volume detach called, but volume not attached. Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9f60c05d-3085-4956-8b9b-c44f6187c409 tempest-VolumesActionsTest-444196845 None] Lock "cinder-93da9f36-c842-4185-a380-30956cd11104-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "cinder-35b84a59-3c56-48ce-8e05-9d4e07be4436-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-35b84a59-3c56-48ce-8e05-9d4e07be4436-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Performing cascade delete. {{(pid=83606) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 16 13:29:29 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5822d813-fb10-49a7-b2f8-f294c706b729 1073741824" returned: 0 in 0.731s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "cinder-14a7af26-d304-4074-af57-e983439eb78a-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-14a7af26-d304-4074-af57-e983439eb78a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "cinder-quobyte-35b84a59-3c56-48ce-8e05-9d4e07be4436" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5822d813-fb10-49a7-b2f8-f294c706b729 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-35b84a59-3c56-48ce-8e05-9d4e07be4436" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "cinder-quobyte-14a7af26-d304-4074-af57-e983439eb78a" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-14a7af26-d304-4074-af57-e983439eb78a" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Deleting offline snapshot 14a7af26-d304-4074-af57-e983439eb78a of volume 35b84a59-3c56-48ce-8e05-9d4e07be4436 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:29:29 devstack sudo[87577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5822d813-fb10-49a7-b2f8-f294c706b729 Apr 16 13:29:29 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] snapshot_file for this snap is: volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af9914e-7a17-42d3-86d9-819a5c2d327f]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:29 devstack sudo[87579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a Apr 16 13:29:29 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] Acquiring lock "cinder-93da9f36-c842-4185-a380-30956cd11104-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] Lock "cinder-93da9f36-c842-4185-a380-30956cd11104-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] Acquiring lock "cinder-quobyte-93da9f36-c842-4185-a380-30956cd11104" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] Lock "cinder-quobyte-93da9f36-c842-4185-a380-30956cd11104" acquired by "delete_volume" :: waited 0.014s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0882a1-e85c-463c-8510-3ef7b5de74a8]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-93da9f36-c842-4185-a380-30956cd11104 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:30 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5822d813-fb10-49a7-b2f8-f294c706b729" returned: 0 in 0.518s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:29:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2ae107-868a-41d1-9dcf-6a54dc3262eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5822d813-fb10-49a7-b2f8-f294c706b729', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86453ff8-da59-47e6-97d7-1319b51cd8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:30 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Volume volume-5822d813-fb10-49a7-b2f8-f294c706b729 (5822d813-fb10-49a7-b2f8-f294c706b729): created successfully Apr 16 13:29:30 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-93da9f36-c842-4185-a380-30956cd11104 Apr 16 13:29:30 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86453ff8-da59-47e6-97d7-1319b51cd8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Flow 'volume_create_manager' (5f1d3dac-3f84-4945-9cf6-f5bc3f24b4a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:30 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a" returned: 0 in 0.530s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35b84a59-3c56-48ce-8e05-9d4e07be4436(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:29:30 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-4ee0fbab-0a4d-42d8-8d93-e7fa9b30aaa5 tempest-VolumesNegativeTest-930746850 None] Created volume successfully. Apr 16 13:29:30 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64d7538-f623-4b9c-b8f8-2fb6b7c44a60]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:30 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af Apr 16 13:29:30 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:30 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-93da9f36-c842-4185-a380-30956cd11104" returned: 0 in 0.891s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-93da9f36-c842-4185-a380-30956cd11104 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:30 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-93da9f36-c842-4185-a380-30956cd11104 Apr 16 13:29:30 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:31 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af" returned: 0 in 0.962s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:31 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35b84a59-3c56-48ce-8e05-9d4e07be4436(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:29:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:31 devstack sudo[87626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a Apr 16 13:29:31 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:31 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-93da9f36-c842-4185-a380-30956cd11104" returned: 0 in 0.471s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] Lock "cinder-quobyte-93da9f36-c842-4185-a380-30956cd11104" released by "delete_volume" :: held 1.385s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:31 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] Created reservations ['a3631793-4b22-4b2b-9e32-869f3795f392', '39add9c2-72d7-426d-a94a-d8181209387e', 'd072d7db-db3e-448f-bf14-2fc63f9deda6', '58dca736-5cff-46af-b8ee-8458582b6b12'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:29:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:31 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:31 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:31 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:29:31 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:31 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a" returned: 0 in 0.633s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:31 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a Apr 16 13:29:31 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:32 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.760s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:29:32 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] Deleted volume successfully. Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-42b1a5c7-f1bc-4746-86e9-0a284cc4688f tempest-VolumesActionsTest-444196845 None] Lock "cinder-93da9f36-c842-4185-a380-30956cd11104-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:32 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.14a7af26-d304-4074-af57-e983439eb78a" returned: 0 in 0.578s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-14a7af26-d304-4074-af57-e983439eb78a" released by "_delete_snapshot" :: held 2.749s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-35b84a59-3c56-48ce-8e05-9d4e07be4436" released by "delete_snapshot" :: held 2.764s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Created reservations ['e583d97c-9d5d-43a7-a9ff-ece02b630cb7', '08e08a86-018a-4c3c-a481-c3a03caf563f', '7f7ec5b4-5891-4137-8df0-ee7a2d01a8c5', '11f32473-e655-468d-8827-e85179098ab6'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:29:32 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Delete snapshot completed successfully. Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-14a7af26-d304-4074-af57-e983439eb78a-delete_snapshot" released by "delete_snapshot" :: held 2.871s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "cinder-64f54519-59d6-4614-97b2-54eda67005af-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-64f54519-59d6-4614-97b2-54eda67005af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "cinder-quobyte-35b84a59-3c56-48ce-8e05-9d4e07be4436" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-35b84a59-3c56-48ce-8e05-9d4e07be4436" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "cinder-quobyte-64f54519-59d6-4614-97b2-54eda67005af" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-64f54519-59d6-4614-97b2-54eda67005af" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Deleting offline snapshot 64f54519-59d6-4614-97b2-54eda67005af of volume 35b84a59-3c56-48ce-8e05-9d4e07be4436 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] snapshot_file for this snap is: volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a5d26c-a84f-4be8-9920-b848c23d19cb]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:32 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af Apr 16 13:29:32 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:32 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af" returned: 0 in 0.541s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35b84a59-3c56-48ce-8e05-9d4e07be4436(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0a5bef-ba1a-435a-9a8b-da93b51b1581]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:33 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436 Apr 16 13:29:33 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:33 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436" returned: 0 in 0.584s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:33 devstack sudo[87668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af Apr 16 13:29:33 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:34 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af" returned: 0 in 0.489s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:34 devstack sudo[87675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af Apr 16 13:29:34 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:34 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436.64f54519-59d6-4614-97b2-54eda67005af" returned: 0 in 0.451s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG oslo_service.periodic_task [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83606) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-64f54519-59d6-4614-97b2-54eda67005af" released by "_delete_snapshot" :: held 2.136s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-35b84a59-3c56-48ce-8e05-9d4e07be4436" released by "delete_snapshot" :: held 2.150s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:34 devstack sudo[87678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:29:34 devstack sudo[87678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Created reservations ['ddd37a94-2bdb-4770-bfb9-fb8e4aa4993e', '767dcbcd-26f9-40f7-a157-a6c7a1fabe1c', 'd17f6229-0c5a-4623-b89d-67ce28f7c88a', '5d6ce723-7e7b-44f0-8f4b-d987a643d105'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:29:34 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Delete snapshot completed successfully. Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-64f54519-59d6-4614-97b2-54eda67005af-delete_snapshot" released by "delete_snapshot" :: held 2.242s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Snapshots deleted, issuing volume delete {{(pid=83606) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "cinder-quobyte-35b84a59-3c56-48ce-8e05-9d4e07be4436" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-35b84a59-3c56-48ce-8e05-9d4e07be4436" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1367d34f-b1e1-4202-8088-ab7e9be4858f]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:34 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436 Apr 16 13:29:34 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:35 devstack sudo[87678]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.555s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:35 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:29:35 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436" returned: 0 in 0.624s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:35 devstack sudo[87687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436 Apr 16 13:29:35 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:35 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-35b84a59-3c56-48ce-8e05-9d4e07be4436" returned: 0 in 0.522s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:35 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-35b84a59-3c56-48ce-8e05-9d4e07be4436" released by "delete_volume" :: held 1.177s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:35 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Created reservations ['36241ecd-e762-466f-97af-bdf000635bd8', '9810bc68-01ac-4699-a587-7a6b34b21ada', '26ef0b57-a78b-40b8-a5c1-13d197ca3002', '53cffb11-c49d-4fd7-bcf8-e0a278ccf41d'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:29:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:35 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:29:35 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Flow 'volume_create_manager' (2a015e25-e964-4ebd-a6e0-2c2dd27d3b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bef61ae-b920-4280-8d44-9fd9c58d6780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bef61ae-b920-4280-8d44-9fd9c58d6780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-294568039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d0422b7-9de2-4952-bbd1-526a7508312f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47e8898c49f4c2298ca5424c1fe91fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:36Z,use_quota=True,user_id='6b2476e24b4541db81b9d053e95969f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664283eb-cc82-435a-a451-4398d162f81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664283eb-cc82-435a-a451-4398d162f81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf66598-d9e2-48ef-adfd-988617220c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf66598-d9e2-48ef-adfd-988617220c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d0422b7-9de2-4952-bbd1-526a7508312f', 'volume_name': 'volume-4d0422b7-9de2-4952-bbd1-526a7508312f', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c83bf37-b05f-48aa-b7b6-ef57d5cd3fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c83bf37-b05f-48aa-b7b6-ef57d5cd3fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c004c52b-3d16-46e0-b703-cce569dcbeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:36 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Volume 4d0422b7-9de2-4952-bbd1-526a7508312f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d0422b7-9de2-4952-bbd1-526a7508312f', 'volume_size': 1} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-294568039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d0422b7-9de2-4952-bbd1-526a7508312f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47e8898c49f4c2298ca5424c1fe91fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:36Z,use_quota=True,user_id='6b2476e24b4541db81b9d053e95969f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Creating volume 4d0422b7-9de2-4952-bbd1-526a7508312f {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:29:36 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:36 devstack sudo[87699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f 1073741824 Apr 16 13:29:36 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:36 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.773s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:29:36 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Deleted volume successfully. Apr 16 13:29:36 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-282e5b39-70ab-436b-aab0-b8b8fb183687 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-35b84a59-3c56-48ce-8e05-9d4e07be4436-delete_volume" released by "delete_volume" :: held 7.283s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:37 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f 1073741824" returned: 0 in 0.708s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:37 devstack sudo[87705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f Apr 16 13:29:37 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:37 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f" returned: 0 in 0.504s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:29:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c004c52b-3d16-46e0-b703-cce569dcbeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d0422b7-9de2-4952-bbd1-526a7508312f', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e11d6a7-a8b5-47e9-85aa-adcda5690fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:37 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Volume volume-4d0422b7-9de2-4952-bbd1-526a7508312f (4d0422b7-9de2-4952-bbd1-526a7508312f): created successfully Apr 16 13:29:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e11d6a7-a8b5-47e9-85aa-adcda5690fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Flow 'volume_create_manager' (2a015e25-e964-4ebd-a6e0-2c2dd27d3b30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:37 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-58cedb3d-3c11-4813-90d4-9a362e28ff22 tempest-VolumesDeleteCascade-657526560 None] Created volume successfully. Apr 16 13:29:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:38 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:29:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Flow 'volume_create_manager' (c94facc3-de2d-42f6-a35c-74f12e9163e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570c7618-6f8b-4a8d-b870-c9832e6a3dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:38 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] Creating offline snapshot 38363763-3c28-4b71-9912-fe5590475fce of volume 4d0422b7-9de2-4952-bbd1-526a7508312f {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:29:38 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[759a28be-1c80-494f-83ce-27790497f0e0]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570c7618-6f8b-4a8d-b870-c9832e6a3dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-526485657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa3ab30-734d-4ba2-87a6-40aeddfd51d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c23133ff0440eb963eda67e43720d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:39Z,use_quota=True,user_id='1f3ac2402b2a4adf855a10612ae6fff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05517330-ff0b-408a-be61-688c69b22a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05517330-ff0b-408a-be61-688c69b22a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25966d7f-306e-4e1b-a092-ee6a1586b27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25966d7f-306e-4e1b-a092-ee6a1586b27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa3ab30-734d-4ba2-87a6-40aeddfd51d0', 'volume_name': 'volume-daa3ab30-734d-4ba2-87a6-40aeddfd51d0', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0cce7dd-1894-46af-91e9-f306d4042a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0cce7dd-1894-46af-91e9-f306d4042a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b405fc7-91bf-49b2-a9bd-860df3d1a8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:38 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Volume daa3ab30-734d-4ba2-87a6-40aeddfd51d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa3ab30-734d-4ba2-87a6-40aeddfd51d0', 'volume_size': 1} Apr 16 13:29:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:38 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f Apr 16 13:29:38 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:39 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f" returned: 0 in 0.655s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:39 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce 1G Apr 16 13:29:39 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:39 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce 1G" returned: 0 in 0.527s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d0422b7-9de2-4952-bbd1-526a7508312f -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:39 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d0422b7-9de2-4952-bbd1-526a7508312f -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce Apr 16 13:29:39 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:40 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d0422b7-9de2-4952-bbd1-526a7508312f -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce" returned: 0 in 0.475s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:40 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce is being set with open permissions: ugo+rw Apr 16 13:29:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:40 devstack sudo[87761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce Apr 16 13:29:40 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:40 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce" returned: 0 in 0.495s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:40 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.info Apr 16 13:29:40 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:41 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.info" returned: 0 in 0.423s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:41 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.info is being set with open permissions: ugo+rw Apr 16 13:29:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:41 devstack sudo[87772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.info Apr 16 13:29:41 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:41 devstack cinder-volume[83606]: INFO cinder.volume.manager [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-df6febf9-6927-4472-9330-bcb7a30e0ec3 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Terminate volume connection completed successfully. Apr 16 13:29:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-df6febf9-6927-4472-9330-bcb7a30e0ec3 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Deleting attachment 2592966b-40fb-45e4-9e17-bbc36dae46be. {{(pid=83606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 13:29:41 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.info" returned: 0 in 0.434s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.088s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.982s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-526485657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa3ab30-734d-4ba2-87a6-40aeddfd51d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c23133ff0440eb963eda67e43720d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:39Z,use_quota=True,user_id='1f3ac2402b2a4adf855a10612ae6fff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:29:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Creating volume daa3ab30-734d-4ba2-87a6-40aeddfd51d0 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:29:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:29:41 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:29:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-daa3ab30-734d-4ba2-87a6-40aeddfd51d0 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:41 devstack sudo[87775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-daa3ab30-734d-4ba2-87a6-40aeddfd51d0 1073741824 Apr 16 13:29:41 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:41 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-cc650454-2613-4e43-ba3a-9d9030252e95 tempest-VolumesDeleteCascade-657526560 None] Create snapshot completed successfully Apr 16 13:29:42 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Acquiring lock "cinder-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:42 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "cinder-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:42 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Acquiring lock "cinder-quobyte-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:42 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "cinder-quobyte-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:42 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[84602389-9832-4744-a338-a506310d714f]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:42 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-daa3ab30-734d-4ba2-87a6-40aeddfd51d0 1073741824" returned: 0 in 0.501s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-daa3ab30-734d-4ba2-87a6-40aeddfd51d0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:42 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-daa3ab30-734d-4ba2-87a6-40aeddfd51d0 Apr 16 13:29:42 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb Apr 16 13:29:42 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:42 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:43 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:43 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-daa3ab30-734d-4ba2-87a6-40aeddfd51d0" returned: 0 in 0.791s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb" returned: 0 in 0.835s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b405fc7-91bf-49b2-a9bd-860df3d1a8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa3ab30-734d-4ba2-87a6-40aeddfd51d0', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:43 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb Apr 16 13:29:43 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5272038b-39fc-460f-ad40-2c90e936300e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:43 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Volume volume-daa3ab30-734d-4ba2-87a6-40aeddfd51d0 (daa3ab30-734d-4ba2-87a6-40aeddfd51d0): created successfully Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5272038b-39fc-460f-ad40-2c90e936300e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Flow 'volume_create_manager' (c94facc3-de2d-42f6-a35c-74f12e9163e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:43 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-070baa06-c338-4d80-a283-8a1ab3ff9eab tempest-VolumesActionsTest-444196845 None] Created volume successfully. Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Flow 'volume_create_manager' (b940e65b-283f-4bcb-be22-778b092fd158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300858a5-7fa8-4053-9993-565c14f6c6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300858a5-7fa8-4053-9993-565c14f6c6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-184216613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3df576f0-30b7-48f6-8e9e-68f07629f16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47e8898c49f4c2298ca5424c1fe91fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=38363763-3c28-4b71-9912-fe5590475fce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:43Z,use_quota=True,user_id='6b2476e24b4541db81b9d053e95969f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d043be8e-254e-4003-85ff-39dff7e2bb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d043be8e-254e-4003-85ff-39dff7e2bb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68cd1a9-ad88-44ca-972d-d7faa66c9f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68cd1a9-ad88-44ca-972d-d7faa66c9f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3df576f0-30b7-48f6-8e9e-68f07629f16f', 'volume_name': 'volume-3df576f0-30b7-48f6-8e9e-68f07629f16f', 'volume_size': 1, 'snapshot_id': '38363763-3c28-4b71-9912-fe5590475fce'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5505f31-3a93-4fa6-aa29-7b938b7caa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5505f31-3a93-4fa6-aa29-7b938b7caa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737049ec-9236-4dee-82f8-8004a3d3e3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:43 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Volume 3df576f0-30b7-48f6-8e9e-68f07629f16f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3df576f0-30b7-48f6-8e9e-68f07629f16f', 'volume_size': 1, 'snapshot_id': '38363763-3c28-4b71-9912-fe5590475fce'} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "cinder-quobyte-38363763-3c28-4b71-9912-fe5590475fce-3df576f0-30b7-48f6-8e9e-68f07629f16f" by "_create_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-38363763-3c28-4b71-9912-fe5590475fce-3df576f0-30b7-48f6-8e9e-68f07629f16f" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Creating volume 3df576f0-30b7-48f6-8e9e-68f07629f16f from snapshot 38363763-3c28-4b71-9912-fe5590475fce {{(pid=83606) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "cinder-quobyte-3df576f0-30b7-48f6-8e9e-68f07629f16f" by "_copy_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-3df576f0-30b7-48f6-8e9e-68f07629f16f" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] snapshot: 38363763-3c28-4b71-9912-fe5590475fce, volume: 3df576f0-30b7-48f6-8e9e-68f07629f16f, {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[51280f86-5633-4cc4-bec0-99e0db3b5d32]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:43 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce Apr 16 13:29:43 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:43 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb" returned: 0 in 0.544s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "cinder-quobyte-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb" released by "delete_volume" :: held 1.408s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.quota [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Created reservations ['6e9a2b7f-1857-4e67-88c4-7ee8432be076', '7e1dd5c9-f783-4d82-a695-71d29276507f', 'e55e1b8e-1b10-4946-a926-9a3fc0965f86', '8a3c8dce-bd2d-4efc-8986-925fd8d8bbca'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:43 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:29:43 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:43 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce" returned: 0 in 0.542s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d0422b7-9de2-4952-bbd1-526a7508312f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Creating direct copy from snapshot {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc03ca35-aca0-4bbb-86b0-d4070e882f28]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:44 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f Apr 16 13:29:44 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:44 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] Acquiring lock "cinder-daa3ab30-734d-4ba2-87a6-40aeddfd51d0-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:44 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] Lock "cinder-daa3ab30-734d-4ba2-87a6-40aeddfd51d0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:44 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.604s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:44 devstack cinder-volume[83606]: DEBUG cinder.manager [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:29:44 devstack cinder-volume[83606]: INFO cinder.volume.manager [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Deleted volume successfully. Apr 16 13:29:44 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] Acquiring lock "cinder-quobyte-daa3ab30-734d-4ba2-87a6-40aeddfd51d0" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:44 devstack cinder-volume[83606]: DEBUG cinder.coordination [req-f8ce5ab1-4cb5-4d95-a8c9-645a6c4d7001 req-9cd482bc-5683-4342-a283-1bef41b774c5 tempest-ServerBootFromVolumeStableRescueTest-1759511993 None] Lock "cinder-5f8995b2-ac10-43a8-b9d2-a70d9f0156fb-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:44 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] Lock "cinder-quobyte-daa3ab30-734d-4ba2-87a6-40aeddfd51d0" acquired by "delete_volume" :: waited 0.052s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:44 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b08fb6-f44d-467e-83f2-1a73ce1c7137]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-daa3ab30-734d-4ba2-87a6-40aeddfd51d0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:44 devstack sudo[87828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-daa3ab30-734d-4ba2-87a6-40aeddfd51d0 Apr 16 13:29:44 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:44 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f" returned: 0 in 0.787s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:44 devstack cinder-volume[83606]: DEBUG cinder.utils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Path /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3df576f0-30b7-48f6-8e9e-68f07629f16f not found in is_blk_device check {{(pid=83606) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 13:29:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3df576f0-30b7-48f6-8e9e-68f07629f16f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:44 devstack sudo[87833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3df576f0-30b7-48f6-8e9e-68f07629f16f Apr 16 13:29:44 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:44 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-daa3ab30-734d-4ba2-87a6-40aeddfd51d0" returned: 0 in 0.585s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-daa3ab30-734d-4ba2-87a6-40aeddfd51d0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:44 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-daa3ab30-734d-4ba2-87a6-40aeddfd51d0 Apr 16 13:29:44 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:45 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-daa3ab30-734d-4ba2-87a6-40aeddfd51d0" returned: 0 in 0.834s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] Lock "cinder-quobyte-daa3ab30-734d-4ba2-87a6-40aeddfd51d0" released by "delete_volume" :: held 1.468s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:45 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] Created reservations ['6b533c54-d753-4458-8988-1205da46d50d', 'dc2c10e8-e98b-440c-837d-ed97e69f8563', '1d475098-e178-4b64-b71b-4d542d324931', 'f238ceb0-d9ef-4cb4-97c2-da00a28be1b9'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:29:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:46 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:29:46 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:29:47 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Flow 'volume_create_manager' (b0726122-36e8-4fba-8a13-06e1a89453f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1373dbdd-488c-48e3-89a7-10a9da7e4559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3df576f0-30b7-48f6-8e9e-68f07629f16f" returned: 0 in 2.810s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[589feae9-fb5f-4e26-afa4-c0e8f4ee221d]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:47 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1373dbdd-488c-48e3-89a7-10a9da7e4559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-124052146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bca18c-6d82-4ca8-b2b0-aa17a833a17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c23133ff0440eb963eda67e43720d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:47Z,use_quota=True,user_id='1f3ac2402b2a4adf855a10612ae6fff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4bb3e5-7f29-42ca-967b-2971a7640a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4bb3e5-7f29-42ca-967b-2971a7640a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17911b8-4b5c-44f4-ac70-e029894eef70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17911b8-4b5c-44f4-ac70-e029894eef70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38bca18c-6d82-4ca8-b2b0-aa17a833a17c', 'volume_name': 'volume-38bca18c-6d82-4ca8-b2b0-aa17a833a17c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4674b8f-be7d-402c-bd40-b3e8e4fbbd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4674b8f-be7d-402c-bd40-b3e8e4fbbd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debe0ddb-e136-4c34-96cf-e43b5dc47670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:47 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Volume 38bca18c-6d82-4ca8-b2b0-aa17a833a17c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38bca18c-6d82-4ca8-b2b0-aa17a833a17c', 'volume_size': 1} Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 1.618s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:29:47 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] Deleted volume successfully. Apr 16 13:29:47 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f Apr 16 13:29:47 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:47 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9b43b96b-86c2-4a77-90c0-06e528dc09c1 tempest-VolumesActionsTest-1792347583 None] Lock "cinder-daa3ab30-734d-4ba2-87a6-40aeddfd51d0-delete_volume" released by "delete_volume" :: held 3.501s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:48 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f" returned: 0 in 0.768s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Image conversion details: src /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f, size 1024.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3df576f0-30b7-48f6-8e9e-68f07629f16f {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:29:48 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Converted 1024.00 MB image at 364.32 MB/s Apr 16 13:29:48 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3df576f0-30b7-48f6-8e9e-68f07629f16f is being set with open permissions: ugo+rw Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3df576f0-30b7-48f6-8e9e-68f07629f16f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:48 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3df576f0-30b7-48f6-8e9e-68f07629f16f Apr 16 13:29:48 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:48 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3df576f0-30b7-48f6-8e9e-68f07629f16f" returned: 0 in 0.445s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-3df576f0-30b7-48f6-8e9e-68f07629f16f" released by "_copy_volume_from_snapshot" :: held 5.419s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-38363763-3c28-4b71-9912-fe5590475fce-3df576f0-30b7-48f6-8e9e-68f07629f16f" released by "_create_volume_from_snapshot" :: held 5.435s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.444s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.104s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-124052146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bca18c-6d82-4ca8-b2b0-aa17a833a17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c23133ff0440eb963eda67e43720d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:47Z,use_quota=True,user_id='1f3ac2402b2a4adf855a10612ae6fff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Creating volume 38bca18c-6d82-4ca8-b2b0-aa17a833a17c {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:29:48 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-38bca18c-6d82-4ca8-b2b0-aa17a833a17c 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737049ec-9236-4dee-82f8-8004a3d3e3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3df576f0-30b7-48f6-8e9e-68f07629f16f', 'volume_size': 1, 'snapshot_id': '38363763-3c28-4b71-9912-fe5590475fce'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:48 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-38bca18c-6d82-4ca8-b2b0-aa17a833a17c 1073741824 Apr 16 13:29:48 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da1c62b-cd23-4dc4-bd5a-ec739d1057c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:48 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Volume volume-3df576f0-30b7-48f6-8e9e-68f07629f16f (3df576f0-30b7-48f6-8e9e-68f07629f16f): created successfully Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da1c62b-cd23-4dc4-bd5a-ec739d1057c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Flow 'volume_create_manager' (b940e65b-283f-4bcb-be22-778b092fd158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:48 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-b6da3ef4-664b-4133-9096-fd7721705b32 tempest-VolumesDeleteCascade-657526560 None] Created volume successfully. Apr 16 13:29:49 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-38bca18c-6d82-4ca8-b2b0-aa17a833a17c 1073741824" returned: 0 in 0.509s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-38bca18c-6d82-4ca8-b2b0-aa17a833a17c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:49 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-38bca18c-6d82-4ca8-b2b0-aa17a833a17c Apr 16 13:29:49 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:49 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-38bca18c-6d82-4ca8-b2b0-aa17a833a17c" returned: 0 in 0.471s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:29:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debe0ddb-e136-4c34-96cf-e43b5dc47670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38bca18c-6d82-4ca8-b2b0-aa17a833a17c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb035c7d-9b77-44a3-8585-e969fc4d2961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:49 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Volume volume-38bca18c-6d82-4ca8-b2b0-aa17a833a17c (38bca18c-6d82-4ca8-b2b0-aa17a833a17c): created successfully Apr 16 13:29:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb035c7d-9b77-44a3-8585-e969fc4d2961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Flow 'volume_create_manager' (b0726122-36e8-4fba-8a13-06e1a89453f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:49 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-65d86f0a-e4ef-49eb-bada-8bdb1e425c94 tempest-VolumesActionsTest-444196845 None] Created volume successfully. Apr 16 13:29:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "cinder-4d0422b7-9de2-4952-bbd1-526a7508312f-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-4d0422b7-9de2-4952-bbd1-526a7508312f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Performing cascade delete. {{(pid=83606) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 16 13:29:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "cinder-38363763-3c28-4b71-9912-fe5590475fce-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-38363763-3c28-4b71-9912-fe5590475fce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "cinder-quobyte-4d0422b7-9de2-4952-bbd1-526a7508312f" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-4d0422b7-9de2-4952-bbd1-526a7508312f" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "cinder-quobyte-38363763-3c28-4b71-9912-fe5590475fce" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-38363763-3c28-4b71-9912-fe5590475fce" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:50 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Deleting offline snapshot 38363763-3c28-4b71-9912-fe5590475fce of volume 4d0422b7-9de2-4952-bbd1-526a7508312f {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:29:50 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] snapshot_file for this snap is: volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:29:50 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[778e1f78-e9b8-4431-b876-5e8584cb492e]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:50 devstack sudo[87917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce Apr 16 13:29:50 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:50 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce" returned: 0 in 0.466s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:50 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d0422b7-9de2-4952-bbd1-526a7508312f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:29:50 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dace1a-2ec6-4d67-b9c7-d1714bfdb8c3]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:50 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f Apr 16 13:29:50 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] Acquiring lock "cinder-38bca18c-6d82-4ca8-b2b0-aa17a833a17c-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] Lock "cinder-38bca18c-6d82-4ca8-b2b0-aa17a833a17c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] Acquiring lock "cinder-quobyte-38bca18c-6d82-4ca8-b2b0-aa17a833a17c" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] Lock "cinder-quobyte-38bca18c-6d82-4ca8-b2b0-aa17a833a17c" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:50 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0856f1a8-826b-44c5-a3a2-4d1c8162aea7]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-38bca18c-6d82-4ca8-b2b0-aa17a833a17c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:50 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-38bca18c-6d82-4ca8-b2b0-aa17a833a17c Apr 16 13:29:50 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:51 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f" returned: 0 in 0.553s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:51 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce Apr 16 13:29:51 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:51 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-38bca18c-6d82-4ca8-b2b0-aa17a833a17c" returned: 0 in 0.489s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-38bca18c-6d82-4ca8-b2b0-aa17a833a17c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:51 devstack sudo[87934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-38bca18c-6d82-4ca8-b2b0-aa17a833a17c Apr 16 13:29:51 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:51 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce" returned: 0 in 0.444s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:51 devstack sudo[87939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce Apr 16 13:29:51 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:51 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-38bca18c-6d82-4ca8-b2b0-aa17a833a17c" returned: 0 in 0.420s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] Lock "cinder-quobyte-38bca18c-6d82-4ca8-b2b0-aa17a833a17c" released by "delete_volume" :: held 0.933s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:51 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] Created reservations ['722fbb05-a143-4a09-b03e-b5d37999b8b0', 'a6a24335-e5a8-434a-8fcc-4527383dd77d', 'b4c500ff-4b6f-4f16-bf89-6234eb687192', '8b538da7-3103-4603-a950-4407715541d6'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:29:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:51 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:51 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:51 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:29:51 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:52 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f.38363763-3c28-4b71-9912-fe5590475fce" returned: 0 in 0.509s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-38363763-3c28-4b71-9912-fe5590475fce" released by "_delete_snapshot" :: held 2.020s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-4d0422b7-9de2-4952-bbd1-526a7508312f" released by "delete_snapshot" :: held 2.032s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Created reservations ['df666bc0-3b71-4a13-aeb5-897c90cca380', '992482d7-517a-4e23-a1d7-37db02a9d6c4', '03572123-5289-461c-900f-b88a98d4a12c', 'ece4cd80-2c20-4029-aa25-9e0098ec1920'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:29:52 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Delete snapshot completed successfully. Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-38363763-3c28-4b71-9912-fe5590475fce-delete_snapshot" released by "delete_snapshot" :: held 2.152s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Snapshots deleted, issuing volume delete {{(pid=83606) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "cinder-quobyte-4d0422b7-9de2-4952-bbd1-526a7508312f" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-4d0422b7-9de2-4952-bbd1-526a7508312f" acquired by "delete_volume" :: waited 0.015s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6889338-51cc-43ce-8cff-a8e317018b6e]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Flow 'volume_create_manager' (11a91147-ae56-4c80-88f6-63bdd2c37b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a631cea3-04c6-4e0b-b2b7-4ddb2a4ce4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a631cea3-04c6-4e0b-b2b7-4ddb2a4ce4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-950369857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987b2be2-68e8-4b03-ba9e-4e2c3cbcac84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c23133ff0440eb963eda67e43720d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:52Z,use_quota=True,user_id='1f3ac2402b2a4adf855a10612ae6fff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f2bc83-e06a-4f03-8d56-294ec33e6bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f2bc83-e06a-4f03-8d56-294ec33e6bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:52 devstack sudo[87946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f Apr 16 13:29:52 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fd20c8-d66a-4f4b-8ab2-b343b727a8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:52 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fd20c8-d66a-4f4b-8ab2-b343b727a8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '987b2be2-68e8-4b03-ba9e-4e2c3cbcac84', 'volume_name': 'volume-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d60a25-d0be-4123-be6d-a2ecb8226d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d60a25-d0be-4123-be6d-a2ecb8226d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c91f17a-6157-4478-9574-50ca6de5c83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:52 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Volume 987b2be2-68e8-4b03-ba9e-4e2c3cbcac84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84', 'volume_size': 1} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-950369857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987b2be2-68e8-4b03-ba9e-4e2c3cbcac84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c23133ff0440eb963eda67e43720d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:52Z,use_quota=True,user_id='1f3ac2402b2a4adf855a10612ae6fff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Creating volume 987b2be2-68e8-4b03-ba9e-4e2c3cbcac84 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:29:52 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.538s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:29:52 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] Deleted volume successfully. Apr 16 13:29:52 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84 1073741824 Apr 16 13:29:52 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-09bd57f4-8a75-4597-9f91-e813c0efd1af tempest-VolumesActionsTest-1792347583 None] Lock "cinder-38bca18c-6d82-4ca8-b2b0-aa17a833a17c-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:52 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f" returned: 0 in 0.574s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:52 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f Apr 16 13:29:52 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:52 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84 1073741824" returned: 0 in 0.498s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:52 devstack sudo[87958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84 Apr 16 13:29:52 devstack sudo[87958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:53 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4d0422b7-9de2-4952-bbd1-526a7508312f" returned: 0 in 0.487s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-4d0422b7-9de2-4952-bbd1-526a7508312f" released by "delete_volume" :: held 1.092s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Created reservations ['10faa54f-62cf-4a92-80ec-451dd4be8075', 'b91c3105-77b9-4f09-8966-f19a56a799ca', '4fd4ece9-0c32-44cb-9d2c-4c667cf6e7b1', '3e274c8e-5721-4947-b995-c56fb6d24b1e'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:53 devstack sudo[87958]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84" returned: 0 in 0.573s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:53 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:29:53 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c91f17a-6157-4478-9574-50ca6de5c83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229525cc-e067-41a3-8b1f-59b93cefe160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:53 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Volume volume-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84 (987b2be2-68e8-4b03-ba9e-4e2c3cbcac84): created successfully Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229525cc-e067-41a3-8b1f-59b93cefe160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Flow 'volume_create_manager' (11a91147-ae56-4c80-88f6-63bdd2c37b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:53 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-fe706c43-1ea2-4c1c-9ab5-8c7dedbf24d2 tempest-VolumesActionsTest-444196845 None] Created volume successfully. Apr 16 13:29:53 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.462s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:29:53 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Deleted volume successfully. Apr 16 13:29:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b414c523-ecd5-4afe-822a-3d0c9a845612 tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-4d0422b7-9de2-4952-bbd1-526a7508312f-delete_volume" released by "delete_volume" :: held 3.889s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] Acquiring lock "cinder-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] Lock "cinder-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] Acquiring lock "cinder-quobyte-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "cinder-3df576f0-30b7-48f6-8e9e-68f07629f16f-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] Lock "cinder-quobyte-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84" acquired by "delete_volume" :: waited 0.020s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-3df576f0-30b7-48f6-8e9e-68f07629f16f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:54 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3f753c-4bfa-48bc-ae80-c933d70ddea9]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "cinder-quobyte-3df576f0-30b7-48f6-8e9e-68f07629f16f" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-3df576f0-30b7-48f6-8e9e-68f07629f16f" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:54 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6df3d7-0143-4892-a693-380533bd7e52]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3df576f0-30b7-48f6-8e9e-68f07629f16f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:54 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84 Apr 16 13:29:54 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:54 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3df576f0-30b7-48f6-8e9e-68f07629f16f Apr 16 13:29:54 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:54 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84" returned: 0 in 0.536s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:55 devstack sudo[87975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84 Apr 16 13:29:55 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:55 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3df576f0-30b7-48f6-8e9e-68f07629f16f" returned: 0 in 0.764s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3df576f0-30b7-48f6-8e9e-68f07629f16f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:55 devstack sudo[87980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3df576f0-30b7-48f6-8e9e-68f07629f16f Apr 16 13:29:55 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:55 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84" returned: 0 in 0.615s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] Lock "cinder-quobyte-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84" released by "delete_volume" :: held 1.179s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] Created reservations ['3e77ef11-a66d-44ca-b572-f28a9dde39a2', '6940a8bf-fb66-48a9-a299-c1c030ef7552', '4b17b839-025e-4dc9-85a2-74f2fc5e0423', '10cf8331-a522-4eb5-a18a-883b0939c00f'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:55 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:29:55 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:55 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3df576f0-30b7-48f6-8e9e-68f07629f16f" returned: 0 in 0.597s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-quobyte-3df576f0-30b7-48f6-8e9e-68f07629f16f" released by "delete_volume" :: held 1.388s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] Created reservations ['a9333b79-1e82-47b7-8329-31a7231fd749', 'e1a63860-6923-4381-b0e0-0b21dff6aaf6', 'eddda988-723b-47d7-815f-9bc7f1ffe2ac', 'c0388a19-46ea-4ee4-8b99-96da038a4342'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:56 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:29:56 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:56 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.543s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:29:56 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] Deleted volume successfully. Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-686622f7-771c-48ac-8112-aa81837f64a5 tempest-VolumesActionsTest-1792347583 None] Lock "cinder-987b2be2-68e8-4b03-ba9e-4e2c3cbcac84-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:56 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.534s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:29:56 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] Deleted volume successfully. Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-741990ab-c244-4050-a712-91d10b8cb1dd tempest-VolumesDeleteCascade-657526560 None] Lock "cinder-3df576f0-30b7-48f6-8e9e-68f07629f16f-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Flow 'volume_create_manager' (f4536e10-1ecb-48d8-842f-eef9b55ffe96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af5c9b9-89c6-4fae-a233-716ada83a0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af5c9b9-89c6-4fae-a233-716ada83a0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1737900640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1af802-fff7-4307-be34-d40babf7a5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c23133ff0440eb963eda67e43720d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:57Z,use_quota=True,user_id='1f3ac2402b2a4adf855a10612ae6fff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c390cc4-f47a-4d8a-a577-33d3d714f304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c390cc4-f47a-4d8a-a577-33d3d714f304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce89dfe-86d2-4a25-b5a1-11908d5060aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce89dfe-86d2-4a25-b5a1-11908d5060aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e1af802-fff7-4307-be34-d40babf7a5f2', 'volume_name': 'volume-5e1af802-fff7-4307-be34-d40babf7a5f2', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5baaa0e3-dc06-4654-8388-9d3a8675bac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5baaa0e3-dc06-4654-8388-9d3a8675bac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd87727-345d-4252-8fa6-3c85f433676a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:56 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Volume 5e1af802-fff7-4307-be34-d40babf7a5f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e1af802-fff7-4307-be34-d40babf7a5f2', 'volume_size': 1} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1737900640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1af802-fff7-4307-be34-d40babf7a5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c23133ff0440eb963eda67e43720d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:57Z,use_quota=True,user_id='1f3ac2402b2a4adf855a10612ae6fff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Creating volume 5e1af802-fff7-4307-be34-d40babf7a5f2 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:29:56 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5e1af802-fff7-4307-be34-d40babf7a5f2 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] Acquiring lock "cinder-5822d813-fb10-49a7-b2f8-f294c706b729-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:56 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5e1af802-fff7-4307-be34-d40babf7a5f2 1073741824 Apr 16 13:29:56 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:56 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] Lock "cinder-5822d813-fb10-49a7-b2f8-f294c706b729-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] Acquiring lock "cinder-quobyte-5822d813-fb10-49a7-b2f8-f294c706b729" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] Lock "cinder-quobyte-5822d813-fb10-49a7-b2f8-f294c706b729" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:57 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fdd3a4-6993-4b56-805b-2a5fe1c6d391]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5822d813-fb10-49a7-b2f8-f294c706b729 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:57 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5822d813-fb10-49a7-b2f8-f294c706b729 Apr 16 13:29:57 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:57 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5e1af802-fff7-4307-be34-d40babf7a5f2 1073741824" returned: 0 in 0.633s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5e1af802-fff7-4307-be34-d40babf7a5f2 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:57 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5e1af802-fff7-4307-be34-d40babf7a5f2 Apr 16 13:29:57 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:57 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5822d813-fb10-49a7-b2f8-f294c706b729" returned: 0 in 0.606s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5822d813-fb10-49a7-b2f8-f294c706b729 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:57 devstack sudo[88009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5822d813-fb10-49a7-b2f8-f294c706b729 Apr 16 13:29:57 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:58 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5e1af802-fff7-4307-be34-d40babf7a5f2" returned: 0 in 0.503s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd87727-345d-4252-8fa6-3c85f433676a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e1af802-fff7-4307-be34-d40babf7a5f2', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b38744-da5f-4815-9f0b-1c3883fb5490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:58 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Volume volume-5e1af802-fff7-4307-be34-d40babf7a5f2 (5e1af802-fff7-4307-be34-d40babf7a5f2): created successfully Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b38744-da5f-4815-9f0b-1c3883fb5490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Flow 'volume_create_manager' (f4536e10-1ecb-48d8-842f-eef9b55ffe96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:58 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-79a4cddb-4496-4887-b8e1-3aa954eb380a tempest-VolumesActionsTest-444196845 None] Created volume successfully. Apr 16 13:29:58 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5822d813-fb10-49a7-b2f8-f294c706b729" returned: 0 in 0.555s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] Lock "cinder-quobyte-5822d813-fb10-49a7-b2f8-f294c706b729" released by "delete_volume" :: held 1.184s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] Created reservations ['baa87f73-0fa8-46d9-8d9f-c7547b9b066f', 'c86cc146-793a-4b4d-8516-b4028ba9b0f5', '04eb3393-9ff9-4ab4-a9d8-599443aa60a2', '4de6e4c8-18a7-4e52-b050-056ff43f77dd'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:58 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:29:58 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:58 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.487s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:29:58 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] Deleted volume successfully. Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-84279ace-c72a-4cff-ac72-55e9faf0a5b7 tempest-VolumesNegativeTest-930746850 None] Lock "cinder-5822d813-fb10-49a7-b2f8-f294c706b729-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Flow 'volume_create_manager' (4cd116b1-072c-4175-9694-be4ec6135b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6cfa2e4-7776-4d3b-a065-f8c5899b00f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6cfa2e4-7776-4d3b-a065-f8c5899b00f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1274684908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef707c78-8d35-4a63-8f6c-f240e3d43fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0c33c77f4611a10d8ea6020a0a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:59Z,use_quota=True,user_id='d70f8223ea3b402f8fce2d6c662ceb86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea15e326-29e0-49c9-8a3e-2fedd46417b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea15e326-29e0-49c9-8a3e-2fedd46417b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976f3c50-1b3d-4836-ba33-87e47626912a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976f3c50-1b3d-4836-ba33-87e47626912a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef707c78-8d35-4a63-8f6c-f240e3d43fda', 'volume_name': 'volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45595c3b-21b4-4c01-8c00-d1e0cf14dc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45595c3b-21b4-4c01-8c00-d1e0cf14dc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb5b560-0d6e-43c0-b29e-80a3620e086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:29:58 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume ef707c78-8d35-4a63-8f6c-f240e3d43fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda', 'volume_size': 1} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1274684908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef707c78-8d35-4a63-8f6c-f240e3d43fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0c33c77f4611a10d8ea6020a0a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:29:59Z,use_quota=True,user_id='d70f8223ea3b402f8fce2d6c662ceb86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Creating volume ef707c78-8d35-4a63-8f6c-f240e3d43fda {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:29:58 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:29:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:58 devstack sudo[88016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda 1073741824 Apr 16 13:29:58 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:59 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] Acquiring lock "cinder-5e1af802-fff7-4307-be34-d40babf7a5f2-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:59 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] Lock "cinder-5e1af802-fff7-4307-be34-d40babf7a5f2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:59 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] Acquiring lock "cinder-quobyte-5e1af802-fff7-4307-be34-d40babf7a5f2" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:29:59 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] Lock "cinder-quobyte-5e1af802-fff7-4307-be34-d40babf7a5f2" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:29:59 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dbc009-7d2d-41ac-84e1-08d713daf2f8]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:29:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5e1af802-fff7-4307-be34-d40babf7a5f2 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:59 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5e1af802-fff7-4307-be34-d40babf7a5f2 Apr 16 13:29:59 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:59 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda 1073741824" returned: 0 in 0.620s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:59 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda Apr 16 13:29:59 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:29:59 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Apr 16 13:29:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5e1af802-fff7-4307-be34-d40babf7a5f2" returned: 0 in 0.659s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:29:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5e1af802-fff7-4307-be34-d40babf7a5f2 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:29:59 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5e1af802-fff7-4307-be34-d40babf7a5f2 Apr 16 13:29:59 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:00 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda" returned: 0 in 0.525s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb5b560-0d6e-43c0-b29e-80a3620e086e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a54d090-480e-4862-b58a-29f49e46dc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:00 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda (ef707c78-8d35-4a63-8f6c-f240e3d43fda): created successfully Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a54d090-480e-4862-b58a-29f49e46dc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Flow 'volume_create_manager' (4cd116b1-072c-4175-9694-be4ec6135b74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:00 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-f5e30298-9d90-4eac-991a-e5550aa40c66 tempest-CreateVolumesFromSnapshotTest-431307883 None] Created volume successfully. Apr 16 13:30:00 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5e1af802-fff7-4307-be34-d40babf7a5f2" returned: 0 in 0.508s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] Lock "cinder-quobyte-5e1af802-fff7-4307-be34-d40babf7a5f2" released by "delete_volume" :: held 1.195s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] Created reservations ['7b03d4b9-81a0-411a-b64e-9d848235ce01', '1c3da976-27bc-4e77-8274-8bc0f57f29d7', '7a94309e-2232-4a93-9122-87c61a283e6d', 'e108c97e-6ff0-4e0c-8630-bbb2225f2889'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:00 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:00 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:00 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.485s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:00 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] Deleted volume successfully. Apr 16 13:30:00 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5a2092b4-17e7-480a-a4f7-a4a55b3736a9 tempest-VolumesActionsTest-1792347583 None] Lock "cinder-5e1af802-fff7-4307-be34-d40babf7a5f2-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Flow 'volume_create_manager' (7a27e637-0918-4f6f-bc68-03f84563318c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a57979-bf5b-4852-82b8-70fad2019106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a57979-bf5b-4852-82b8-70fad2019106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-581588326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7355b7ec-54ac-4391-8911-471ace39f755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='429f0688090f466482fb66b8ab2e9b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:01Z,use_quota=True,user_id='7198c66972aa46ebbf92b6edbab299ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c8313e4-7d2e-4997-b90b-95282a303055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c8313e4-7d2e-4997-b90b-95282a303055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b8808f-9eef-494a-a4da-13eeff03dcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b8808f-9eef-494a-a4da-13eeff03dcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7355b7ec-54ac-4391-8911-471ace39f755', 'volume_name': 'volume-7355b7ec-54ac-4391-8911-471ace39f755', 'volume_size': 2}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ab7a4d-85a3-4620-8ec3-284f6aec1c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ab7a4d-85a3-4620-8ec3-284f6aec1c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b416c936-ad3b-4aea-b67d-e767e81c48af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:01 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Volume 7355b7ec-54ac-4391-8911-471ace39f755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7355b7ec-54ac-4391-8911-471ace39f755', 'volume_size': 2} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-581588326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7355b7ec-54ac-4391-8911-471ace39f755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='429f0688090f466482fb66b8ab2e9b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:01Z,use_quota=True,user_id='7198c66972aa46ebbf92b6edbab299ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Creating volume 7355b7ec-54ac-4391-8911-471ace39f755 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:01 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755 2147483648 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:01 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755 2147483648 Apr 16 13:30:01 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Flow 'volume_create_manager' (9d7fe386-9e58-404d-a93a-199a074d83cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b07a759-3e11-4d29-b4f7-27689732036d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b07a759-3e11-4d29-b4f7-27689732036d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1015783992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80146a9c-945d-456a-9fec-3d0ae5abc075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c23133ff0440eb963eda67e43720d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:02Z,use_quota=True,user_id='1f3ac2402b2a4adf855a10612ae6fff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8299ce80-6545-474b-b60e-646ccd983d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8299ce80-6545-474b-b60e-646ccd983d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3ad59e-75a2-4343-8ed4-ad6b571ccba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3ad59e-75a2-4343-8ed4-ad6b571ccba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80146a9c-945d-456a-9fec-3d0ae5abc075', 'volume_name': 'volume-80146a9c-945d-456a-9fec-3d0ae5abc075', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d943e3-425f-469d-8ca0-1624f3122c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d943e3-425f-469d-8ca0-1624f3122c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27b7edf-009a-444f-a0be-9170d80543a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:01 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Volume 80146a9c-945d-456a-9fec-3d0ae5abc075: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80146a9c-945d-456a-9fec-3d0ae5abc075', 'volume_size': 1} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:01 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755 2147483648" returned: 0 in 0.717s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:01 devstack sudo[88074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755 Apr 16 13:30:01 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:02 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755" returned: 0 in 0.463s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.130s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] Creating offline snapshot 5f1f5442-e108-4e59-8e55-085c884884c3 of volume ef707c78-8d35-4a63-8f6c-f240e3d43fda {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:30:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b416c936-ad3b-4aea-b67d-e767e81c48af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7355b7ec-54ac-4391-8911-471ace39f755', 'volume_size': 2}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d7af32-eba3-4472-8239-330f4fc15f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:02 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[be67053c-7fdb-4ea2-8310-c3cc49cc26f3]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:02 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Volume volume-7355b7ec-54ac-4391-8911-471ace39f755 (7355b7ec-54ac-4391-8911-471ace39f755): created successfully Apr 16 13:30:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d7af32-eba3-4472-8239-330f4fc15f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Flow 'volume_create_manager' (7a27e637-0918-4f6f-bc68-03f84563318c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:02 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-74f70cdb-4a47-4523-9f06-319ea7fc07d5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Created volume successfully. Apr 16 13:30:02 devstack sudo[88077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda Apr 16 13:30:02 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:02 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda" returned: 0 in 0.588s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:02 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3 1G Apr 16 13:30:02 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:03 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3 1G" returned: 0 in 0.535s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:03 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3 Apr 16 13:30:03 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:03 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3" returned: 0 in 0.496s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:03 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3 is being set with open permissions: ugo+rw Apr 16 13:30:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:03 devstack sudo[88095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3 Apr 16 13:30:03 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:04 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3" returned: 0 in 0.450s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:04 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.info Apr 16 13:30:04 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:05 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.info" returned: 0 in 0.570s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:05 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.info is being set with open permissions: ugo+rw Apr 16 13:30:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:05 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.info Apr 16 13:30:05 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:05 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.info" returned: 0 in 0.488s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.201s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.854s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1015783992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80146a9c-945d-456a-9fec-3d0ae5abc075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c23133ff0440eb963eda67e43720d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:02Z,use_quota=True,user_id='1f3ac2402b2a4adf855a10612ae6fff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Creating volume 80146a9c-945d-456a-9fec-3d0ae5abc075 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:05 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-80146a9c-945d-456a-9fec-3d0ae5abc075 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:05 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-cf3b1c38-5661-4d57-be83-f43738b42a30 tempest-CreateVolumesFromSnapshotTest-431307883 None] Create snapshot completed successfully Apr 16 13:30:05 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-80146a9c-945d-456a-9fec-3d0ae5abc075 1073741824 Apr 16 13:30:05 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:06 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-80146a9c-945d-456a-9fec-3d0ae5abc075 1073741824" returned: 0 in 0.536s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-80146a9c-945d-456a-9fec-3d0ae5abc075 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:06 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-80146a9c-945d-456a-9fec-3d0ae5abc075 Apr 16 13:30:06 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:06 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-80146a9c-945d-456a-9fec-3d0ae5abc075" returned: 0 in 0.458s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.336s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27b7edf-009a-444f-a0be-9170d80543a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80146a9c-945d-456a-9fec-3d0ae5abc075', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4079df8a-3193-4f4c-a4c0-50021127ddcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Creating offline snapshot e2630942-5546-4f85-bd42-f77802305d0a of volume 7355b7ec-54ac-4391-8911-471ace39f755 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:30:06 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Volume volume-80146a9c-945d-456a-9fec-3d0ae5abc075 (80146a9c-945d-456a-9fec-3d0ae5abc075): created successfully Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4079df8a-3193-4f4c-a4c0-50021127ddcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Flow 'volume_create_manager' (9d7fe386-9e58-404d-a93a-199a074d83cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eedad71-b0b3-44a6-a030-808b351abfe7]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Flow 'volume_create_manager' (06eb2716-9e91-4099-89e7-5409ae1a75de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9f723a-4967-4fcf-bc31-7cce0930795e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9f723a-4967-4fcf-bc31-7cce0930795e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1351031298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00445c5-1c2a-48c3-b0dd-c02307649022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0c33c77f4611a10d8ea6020a0a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:07Z,use_quota=True,user_id='d70f8223ea3b402f8fce2d6c662ceb86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a02869d-4dd4-4153-a7bd-1a7e6616350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a02869d-4dd4-4153-a7bd-1a7e6616350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a4d3e3-1a57-4b78-9186-e59f7b65ebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a4d3e3-1a57-4b78-9186-e59f7b65ebbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e00445c5-1c2a-48c3-b0dd-c02307649022', 'volume_name': 'volume-e00445c5-1c2a-48c3-b0dd-c02307649022', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece99131-3703-43a0-acdc-d40ca918566b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece99131-3703-43a0-acdc-d40ca918566b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae7c847-667b-4a19-af5e-a5e0de00c095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:06 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume e00445c5-1c2a-48c3-b0dd-c02307649022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e00445c5-1c2a-48c3-b0dd-c02307649022', 'volume_size': 1} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:06 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-6eb8e30f-bf76-405a-a820-bc902e2743a0 tempest-VolumesActionsTest-444196845 None] Created volume successfully. Apr 16 13:30:06 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755 Apr 16 13:30:06 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Flow 'volume_create_manager' (4e5c574e-4953-43e0-991f-ee2cd281cb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec025304-e2a6-4c48-abff-6e09e1f7b3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec025304-e2a6-4c48-abff-6e09e1f7b3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2004553700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0c33c77f4611a10d8ea6020a0a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:07Z,use_quota=True,user_id='d70f8223ea3b402f8fce2d6c662ceb86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b169fd-78bc-4fd0-911e-15bb3b509a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b169fd-78bc-4fd0-911e-15bb3b509a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1371cc80-3792-439b-8e51-7010c96333e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1371cc80-3792-439b-8e51-7010c96333e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3', 'volume_name': 'volume-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d663369e-eba7-4c6c-bb07-8d4f695b2bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d663369e-eba7-4c6c-bb07-8d4f695b2bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebcf75f-9b08-4f25-805f-9ca34fe2575f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:06 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume 2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3', 'volume_size': 1} Apr 16 13:30:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Flow 'volume_create_manager' (a1011eca-27ab-492b-b0f4-a1d8a6b69231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11944870-8a63-4661-b8e7-ee51a620c8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11944870-8a63-4661-b8e7-ee51a620c8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-181126143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f91b072-04dd-4b05-98df-892514318dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0c33c77f4611a10d8ea6020a0a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:07Z,use_quota=True,user_id='d70f8223ea3b402f8fce2d6c662ceb86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66d034e-ff25-423a-be10-7f6703ae142a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66d034e-ff25-423a-be10-7f6703ae142a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da7d6ef-7f33-4190-979d-8874b6fe954b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:07 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da7d6ef-7f33-4190-979d-8874b6fe954b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f91b072-04dd-4b05-98df-892514318dd8', 'volume_name': 'volume-5f91b072-04dd-4b05-98df-892514318dd8', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca18380-4954-4ce3-94ed-28599fd7d4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca18380-4954-4ce3-94ed-28599fd7d4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c2cad3-7421-455c-ad9b-e687c5c13de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:07 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume 5f91b072-04dd-4b05-98df-892514318dd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f91b072-04dd-4b05-98df-892514318dd8', 'volume_size': 1} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755" returned: 0 in 0.655s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a 2G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:07 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a 2G Apr 16 13:30:07 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] Acquiring lock "cinder-80146a9c-945d-456a-9fec-3d0ae5abc075-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Flow 'volume_create_manager' (380805f7-84bf-4f25-b5b3-3a2aa89f2581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a50222-6cc5-478d-a4f1-299a4754b9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] Lock "cinder-80146a9c-945d-456a-9fec-3d0ae5abc075-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a50222-6cc5-478d-a4f1-299a4754b9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-615456305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21bdb59-c800-453d-9caf-3bd7604fe120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0c33c77f4611a10d8ea6020a0a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:07Z,use_quota=True,user_id='d70f8223ea3b402f8fce2d6c662ceb86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (becead4c-b6b6-43fd-bbed-deb726c9e943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (becead4c-b6b6-43fd-bbed-deb726c9e943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8850707-5272-4c19-9ff0-db34f7b63efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8850707-5272-4c19-9ff0-db34f7b63efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e21bdb59-c800-453d-9caf-3bd7604fe120', 'volume_name': 'volume-e21bdb59-c800-453d-9caf-3bd7604fe120', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf864de4-b5be-4bda-a514-2a7c4a51b5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf864de4-b5be-4bda-a514-2a7c4a51b5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc91186-e75f-45c4-a479-9d17d6bb0ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:07 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume e21bdb59-c800-453d-9caf-3bd7604fe120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e21bdb59-c800-453d-9caf-3bd7604fe120', 'volume_size': 1} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] Acquiring lock "cinder-quobyte-80146a9c-945d-456a-9fec-3d0ae5abc075" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] Lock "cinder-quobyte-80146a9c-945d-456a-9fec-3d0ae5abc075" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eca0bc-a9c7-42d7-96af-e3a84bd780ee]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-80146a9c-945d-456a-9fec-3d0ae5abc075 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:07 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-80146a9c-945d-456a-9fec-3d0ae5abc075 Apr 16 13:30:07 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Flow 'volume_create_manager' (5ae65c25-3d62-4790-9815-03c3cd0a1d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60dd4d82-c9bf-442c-ba08-86f6a457351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60dd4d82-c9bf-442c-ba08-86f6a457351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2138701815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=688ab291-eb83-46f2-8a9b-9328c70b6c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0c33c77f4611a10d8ea6020a0a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:08Z,use_quota=True,user_id='d70f8223ea3b402f8fce2d6c662ceb86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d9a6269-d268-482d-a94d-bbea53567977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d9a6269-d268-482d-a94d-bbea53567977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ec6937-0acf-4407-83d4-52825f8cfbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ec6937-0acf-4407-83d4-52825f8cfbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '688ab291-eb83-46f2-8a9b-9328c70b6c92', 'volume_name': 'volume-688ab291-eb83-46f2-8a9b-9328c70b6c92', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ff7df4-df34-4d9b-90a7-a1def1d9e635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ff7df4-df34-4d9b-90a7-a1def1d9e635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9ce06c-5ea9-4075-b430-0c717aecceca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:07 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume 688ab291-eb83-46f2-8a9b-9328c70b6c92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-688ab291-eb83-46f2-8a9b-9328c70b6c92', 'volume_size': 1} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:07 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a 2G" returned: 0 in 0.597s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7355b7ec-54ac-4391-8911-471ace39f755 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:07 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7355b7ec-54ac-4391-8911-471ace39f755 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a Apr 16 13:30:07 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:08 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-80146a9c-945d-456a-9fec-3d0ae5abc075" returned: 0 in 0.575s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-80146a9c-945d-456a-9fec-3d0ae5abc075 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:08 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-80146a9c-945d-456a-9fec-3d0ae5abc075 Apr 16 13:30:08 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:08 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7355b7ec-54ac-4391-8911-471ace39f755 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a" returned: 0 in 0.427s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:08 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a is being set with open permissions: ugo+rw Apr 16 13:30:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:08 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a Apr 16 13:30:08 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:08 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-80146a9c-945d-456a-9fec-3d0ae5abc075" returned: 0 in 0.434s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] Lock "cinder-quobyte-80146a9c-945d-456a-9fec-3d0ae5abc075" released by "delete_volume" :: held 1.035s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:08 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] Created reservations ['dfe82941-4bcd-4d0e-be7e-da942bdeeff1', 'eb596a16-bd6a-4515-b8b2-788b2a6a3880', '820ac23d-f81e-4325-b3a2-fe0ea1e5744d', '2958a9f4-05e4-48b9-bb77-2088b422b079'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:08 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:08 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:08 devstack sudo[88142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:08 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:08 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a" returned: 0 in 0.424s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:08 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.info Apr 16 13:30:08 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:09 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.458s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:09 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:09 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] Deleted volume successfully. Apr 16 13:30:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8108769e-0a00-4714-a749-db62df995a0f tempest-VolumesActionsTest-444196845 None] Lock "cinder-80146a9c-945d-456a-9fec-3d0ae5abc075-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:09 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.info" returned: 0 in 0.446s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:09 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.info is being set with open permissions: ugo+rw Apr 16 13:30:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:09 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.info Apr 16 13:30:09 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:09 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.info" returned: 0 in 0.447s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.103s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.935s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:09 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1351031298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00445c5-1c2a-48c3-b0dd-c02307649022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0c33c77f4611a10d8ea6020a0a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:07Z,use_quota=True,user_id='d70f8223ea3b402f8fce2d6c662ceb86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:09 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Creating volume e00445c5-1c2a-48c3-b0dd-c02307649022 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:09 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:09 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:09 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:09 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e00445c5-1c2a-48c3-b0dd-c02307649022 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:09 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e00445c5-1c2a-48c3-b0dd-c02307649022 1073741824 Apr 16 13:30:09 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:09 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-49333bca-3b97-4fb9-9f4e-7f31ba50f27c tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Create snapshot completed successfully Apr 16 13:30:10 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e00445c5-1c2a-48c3-b0dd-c02307649022 1073741824" returned: 0 in 0.680s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e00445c5-1c2a-48c3-b0dd-c02307649022 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:10 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e00445c5-1c2a-48c3-b0dd-c02307649022 Apr 16 13:30:10 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:10 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Acquiring lock "cinder-e2630942-5546-4f85-bd42-f77802305d0a-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:10 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "cinder-e2630942-5546-4f85-bd42-f77802305d0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:10 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Acquiring lock "cinder-quobyte-7355b7ec-54ac-4391-8911-471ace39f755" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:10 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "cinder-quobyte-7355b7ec-54ac-4391-8911-471ace39f755" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:10 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Acquiring lock "cinder-quobyte-e2630942-5546-4f85-bd42-f77802305d0a" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:10 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "cinder-quobyte-e2630942-5546-4f85-bd42-f77802305d0a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Deleting offline snapshot e2630942-5546-4f85-bd42-f77802305d0a of volume 7355b7ec-54ac-4391-8911-471ace39f755 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:30:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] snapshot_file for this snap is: volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:30:10 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2357fa-1302-4095-b375-afe4595d85cc]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:10 devstack sudo[88158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a Apr 16 13:30:10 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:10 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e00445c5-1c2a-48c3-b0dd-c02307649022" returned: 0 in 0.585s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.108s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2004553700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0c33c77f4611a10d8ea6020a0a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:07Z,use_quota=True,user_id='d70f8223ea3b402f8fce2d6c662ceb86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Creating volume 2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:11 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae7c847-667b-4a19-af5e-a5e0de00c095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e00445c5-1c2a-48c3-b0dd-c02307649022', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276e429b-5a42-41e2-ac29-0c16c6b82efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:11 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3 1073741824 Apr 16 13:30:11 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:11 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume volume-e00445c5-1c2a-48c3-b0dd-c02307649022 (e00445c5-1c2a-48c3-b0dd-c02307649022): created successfully Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276e429b-5a42-41e2-ac29-0c16c6b82efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Flow 'volume_create_manager' (06eb2716-9e91-4099-89e7-5409ae1a75de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:11 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-968620c4-924a-4951-ad8e-cfea47ffb1e2 tempest-CreateVolumesFromSnapshotTest-431307883 None] Created volume successfully. Apr 16 13:30:11 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a" returned: 0 in 0.617s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7355b7ec-54ac-4391-8911-471ace39f755(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[004ec376-4cec-4749-bda6-14fea840fc0b]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:11 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755 Apr 16 13:30:11 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:11 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3 1073741824" returned: 0 in 0.642s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:11 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3 Apr 16 13:30:11 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:11 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755" returned: 0 in 0.583s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:11 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a Apr 16 13:30:11 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:12 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3" returned: 0 in 0.616s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.994s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-181126143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f91b072-04dd-4b05-98df-892514318dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0c33c77f4611a10d8ea6020a0a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:07Z,use_quota=True,user_id='d70f8223ea3b402f8fce2d6c662ceb86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Creating volume 5f91b072-04dd-4b05-98df-892514318dd8 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:12 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f91b072-04dd-4b05-98df-892514318dd8 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebcf75f-9b08-4f25-805f-9ca34fe2575f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893f3948-08f4-4108-b46b-5aa441aed25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:12 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f91b072-04dd-4b05-98df-892514318dd8 1073741824 Apr 16 13:30:12 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:12 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume volume-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3 (2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3): created successfully Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893f3948-08f4-4108-b46b-5aa441aed25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Flow 'volume_create_manager' (4e5c574e-4953-43e0-991f-ee2cd281cb2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:12 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-c10a2af4-f911-4b37-9d78-0059025a019e tempest-CreateVolumesFromSnapshotTest-431307883 None] Created volume successfully. Apr 16 13:30:12 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a" returned: 0 in 0.703s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:12 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a Apr 16 13:30:12 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:13 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f91b072-04dd-4b05-98df-892514318dd8 1073741824" returned: 0 in 0.677s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f91b072-04dd-4b05-98df-892514318dd8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:13 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f91b072-04dd-4b05-98df-892514318dd8 Apr 16 13:30:13 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:13 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755.e2630942-5546-4f85-bd42-f77802305d0a" returned: 0 in 0.714s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "cinder-quobyte-e2630942-5546-4f85-bd42-f77802305d0a" released by "_delete_snapshot" :: held 2.693s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "cinder-quobyte-7355b7ec-54ac-4391-8911-471ace39f755" released by "delete_snapshot" :: held 2.705s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Created reservations ['e590bd98-5947-46de-a768-848a24087d21', '3ad1d291-820f-412a-8f7f-d12e436ef2ec', 'd5d6e5f3-460e-4410-a3e7-c84e339fd8b5', '025186a3-7f1b-4958-ab6d-e20bcd673cda'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:13 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Delete snapshot completed successfully. Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0a3b623b-29ed-4b5e-b406-bf97e2f6e9c5 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "cinder-e2630942-5546-4f85-bd42-f77802305d0a-delete_snapshot" released by "delete_snapshot" :: held 2.813s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:13 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f91b072-04dd-4b05-98df-892514318dd8" returned: 0 in 0.488s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.990s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-615456305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21bdb59-c800-453d-9caf-3bd7604fe120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0c33c77f4611a10d8ea6020a0a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:07Z,use_quota=True,user_id='d70f8223ea3b402f8fce2d6c662ceb86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Creating volume e21bdb59-c800-453d-9caf-3bd7604fe120 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:13 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e21bdb59-c800-453d-9caf-3bd7604fe120 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:13 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e21bdb59-c800-453d-9caf-3bd7604fe120 1073741824 Apr 16 13:30:13 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c2cad3-7421-455c-ad9b-e687c5c13de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f91b072-04dd-4b05-98df-892514318dd8', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18d95c7-1abb-4439-80a4-66b86cbf66d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:13 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume volume-5f91b072-04dd-4b05-98df-892514318dd8 (5f91b072-04dd-4b05-98df-892514318dd8): created successfully Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18d95c7-1abb-4439-80a4-66b86cbf66d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Flow 'volume_create_manager' (a1011eca-27ab-492b-b0f4-a1d8a6b69231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:13 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-6ccdbd72-af6f-4ded-a631-03e75ad9f369 tempest-CreateVolumesFromSnapshotTest-431307883 None] Created volume successfully. Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Acquiring lock "cinder-7355b7ec-54ac-4391-8911-471ace39f755-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "cinder-7355b7ec-54ac-4391-8911-471ace39f755-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Acquiring lock "cinder-quobyte-7355b7ec-54ac-4391-8911-471ace39f755" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "cinder-quobyte-7355b7ec-54ac-4391-8911-471ace39f755" acquired by "delete_volume" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68a264e-3f87-4a15-928d-49f0037ea932]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:13 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755 Apr 16 13:30:13 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:14 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e21bdb59-c800-453d-9caf-3bd7604fe120 1073741824" returned: 0 in 0.580s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e21bdb59-c800-453d-9caf-3bd7604fe120 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:14 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e21bdb59-c800-453d-9caf-3bd7604fe120 Apr 16 13:30:14 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:14 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755" returned: 0 in 0.599s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:14 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755 Apr 16 13:30:14 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:14 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e21bdb59-c800-453d-9caf-3bd7604fe120" returned: 0 in 0.503s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.841s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2138701815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=688ab291-eb83-46f2-8a9b-9328c70b6c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0c33c77f4611a10d8ea6020a0a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:08Z,use_quota=True,user_id='d70f8223ea3b402f8fce2d6c662ceb86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Creating volume 688ab291-eb83-46f2-8a9b-9328c70b6c92 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:14 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-688ab291-eb83-46f2-8a9b-9328c70b6c92 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc91186-e75f-45c4-a479-9d17d6bb0ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e21bdb59-c800-453d-9caf-3bd7604fe120', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c15dd7-ece7-4f20-a6b7-42ae2c104879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:14 devstack sudo[88243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-688ab291-eb83-46f2-8a9b-9328c70b6c92 1073741824 Apr 16 13:30:14 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:14 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume volume-e21bdb59-c800-453d-9caf-3bd7604fe120 (e21bdb59-c800-453d-9caf-3bd7604fe120): created successfully Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c15dd7-ece7-4f20-a6b7-42ae2c104879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Flow 'volume_create_manager' (380805f7-84bf-4f25-b5b3-3a2aa89f2581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:14 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-6d497e6b-0d3a-46d6-b367-8b4a282cf23c tempest-CreateVolumesFromSnapshotTest-431307883 None] Created volume successfully. Apr 16 13:30:14 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7355b7ec-54ac-4391-8911-471ace39f755" returned: 0 in 0.440s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "cinder-quobyte-7355b7ec-54ac-4391-8911-471ace39f755" released by "delete_volume" :: held 1.069s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Created reservations ['6dd21e4c-bf0b-4864-9fe8-0a2b414d9297', 'f0a7e56a-f83c-4b35-a775-660049b6495d', '0d159ae4-cffa-418e-b1d6-d5613fb8f06b', 'df5b2ba7-cdbc-44a5-b041-48d28d55c5ca'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:14 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:14 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:15 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-688ab291-eb83-46f2-8a9b-9328c70b6c92 1073741824" returned: 0 in 0.580s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-688ab291-eb83-46f2-8a9b-9328c70b6c92 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:15 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-688ab291-eb83-46f2-8a9b-9328c70b6c92 Apr 16 13:30:15 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:15 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.581s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:15 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:15 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Deleted volume successfully. Apr 16 13:30:15 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9709cf28-b640-44ad-84a7-7b8f4f349977 tempest-VolumesSnapshotNegativeTestJSON-1633793340 None] Lock "cinder-7355b7ec-54ac-4391-8911-471ace39f755-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:15 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-688ab291-eb83-46f2-8a9b-9328c70b6c92" returned: 0 in 0.548s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:15 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9ce06c-5ea9-4075-b430-0c717aecceca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-688ab291-eb83-46f2-8a9b-9328c70b6c92', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:15 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16decb0-8969-4599-86dd-395b2fe2e340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:15 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Volume volume-688ab291-eb83-46f2-8a9b-9328c70b6c92 (688ab291-eb83-46f2-8a9b-9328c70b6c92): created successfully Apr 16 13:30:15 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16decb0-8969-4599-86dd-395b2fe2e340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:15 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Flow 'volume_create_manager' (5ae65c25-3d62-4790-9815-03c3cd0a1d9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:15 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-98b77632-3344-4135-b15f-9e9443f7c232 tempest-CreateVolumesFromSnapshotTest-431307883 None] Created volume successfully. Apr 16 13:30:16 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "cinder-688ab291-eb83-46f2-8a9b-9328c70b6c92-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:16 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-688ab291-eb83-46f2-8a9b-9328c70b6c92-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:16 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "cinder-quobyte-688ab291-eb83-46f2-8a9b-9328c70b6c92" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:16 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-quobyte-688ab291-eb83-46f2-8a9b-9328c70b6c92" acquired by "delete_volume" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:16 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65c9c7b-2e5d-4091-b4be-08a8a50eaf9c]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-688ab291-eb83-46f2-8a9b-9328c70b6c92 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:16 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-688ab291-eb83-46f2-8a9b-9328c70b6c92 Apr 16 13:30:16 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:17 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-688ab291-eb83-46f2-8a9b-9328c70b6c92" returned: 0 in 0.846s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-688ab291-eb83-46f2-8a9b-9328c70b6c92 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:17 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-688ab291-eb83-46f2-8a9b-9328c70b6c92 Apr 16 13:30:17 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:18 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-688ab291-eb83-46f2-8a9b-9328c70b6c92" returned: 0 in 0.538s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:18 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-quobyte-688ab291-eb83-46f2-8a9b-9328c70b6c92" released by "delete_volume" :: held 1.445s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:18 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:UPDATE=216,cinder:DELETE=22,cinder:SELECT=150,cinder:INSERT=44 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:30:18 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Created reservations ['29d68cae-0cf8-4d61-aab0-70b9b4ff3ab5', 'a79c4919-fbb7-464d-9324-466c354bbf36', 'b5415771-6425-4b26-bdc8-ae2ce38f74b2', '92734785-7b26-4281-bc65-ab5c99a62093'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:18 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:18 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:18 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:18 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "cinder-e21bdb59-c800-453d-9caf-3bd7604fe120-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-e21bdb59-c800-453d-9caf-3bd7604fe120-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:UPDATE=199,cinder:DELETE=16,cinder:SELECT=171,cinder:INSERT=58 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:30:19 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.958s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:19 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Deleted volume successfully. Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "cinder-quobyte-e21bdb59-c800-453d-9caf-3bd7604fe120" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-84109c82-b4fc-4ba9-a7b8-abb41c9911c6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-688ab291-eb83-46f2-8a9b-9328c70b6c92-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-quobyte-e21bdb59-c800-453d-9caf-3bd7604fe120" acquired by "delete_volume" :: waited 0.014s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d198b23e-2ef5-43bb-882f-f9fa33cfb12c]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e21bdb59-c800-453d-9caf-3bd7604fe120 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:19 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e21bdb59-c800-453d-9caf-3bd7604fe120 Apr 16 13:30:19 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Flow 'volume_create_manager' (8ea8abfd-c2a6-4451-8df7-25d51a755371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e5c07b-adfb-498c-9b15-3b1c1d88925b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e5c07b-adfb-498c-9b15-3b1c1d88925b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1908746459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f32cb8-dd62-4b2b-a45c-205c5df09710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeee293d363642269d65911e46ed3be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:20Z,use_quota=True,user_id='edd5faa410354e6bbb01b37ae9de57cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c88cd0-d762-4caa-907c-9b5e0597f95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c88cd0-d762-4caa-907c-9b5e0597f95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d006377-2ee0-4501-888d-ffeb1544d549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d006377-2ee0-4501-888d-ffeb1544d549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f32cb8-dd62-4b2b-a45c-205c5df09710', 'volume_name': 'volume-e6f32cb8-dd62-4b2b-a45c-205c5df09710', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4269d7-4e45-438a-9461-c8431b285b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4269d7-4e45-438a-9461-c8431b285b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7dbc30a-2363-4114-816f-047b43535a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:20 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Volume e6f32cb8-dd62-4b2b-a45c-205c5df09710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f32cb8-dd62-4b2b-a45c-205c5df09710', 'volume_size': 1} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1908746459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f32cb8-dd62-4b2b-a45c-205c5df09710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeee293d363642269d65911e46ed3be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:20Z,use_quota=True,user_id='edd5faa410354e6bbb01b37ae9de57cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Creating volume e6f32cb8-dd62-4b2b-a45c-205c5df09710 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:20 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e6f32cb8-dd62-4b2b-a45c-205c5df09710 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:20 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e6f32cb8-dd62-4b2b-a45c-205c5df09710 1073741824 Apr 16 13:30:20 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Flow 'volume_create_manager' (9ae3c7da-5ac6-44ca-b39c-6ee0afc77e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8508f15-6c52-428a-a671-2d9541f21eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8508f15-6c52-428a-a671-2d9541f21eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1091041269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efc0110-2167-4b18-adbf-783cde2dc50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeee293d363642269d65911e46ed3be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:20Z,use_quota=True,user_id='edd5faa410354e6bbb01b37ae9de57cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5455a9a-6871-4ef8-9653-f1187a2b0bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5455a9a-6871-4ef8-9653-f1187a2b0bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff98bbe-c447-454f-8b8e-0d5a09144087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff98bbe-c447-454f-8b8e-0d5a09144087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8efc0110-2167-4b18-adbf-783cde2dc50f', 'volume_name': 'volume-8efc0110-2167-4b18-adbf-783cde2dc50f', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e28108-418f-46d7-9b88-b97cb95f76be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e28108-418f-46d7-9b88-b97cb95f76be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9f791e-1f8a-4f06-8af9-da77d9d8bf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:20 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Volume 8efc0110-2167-4b18-adbf-783cde2dc50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8efc0110-2167-4b18-adbf-783cde2dc50f', 'volume_size': 1} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:20 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e21bdb59-c800-453d-9caf-3bd7604fe120" returned: 0 in 1.520s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e21bdb59-c800-453d-9caf-3bd7604fe120 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:20 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e21bdb59-c800-453d-9caf-3bd7604fe120 Apr 16 13:30:20 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Flow 'volume_create_manager' (25bd4799-c6f5-4feb-92ff-9faa4b7b0fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1dcf12-ca5e-427d-b5db-383ec55a8cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1dcf12-ca5e-427d-b5db-383ec55a8cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-684017980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895a860b-0530-438a-8775-a141a94bc07d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeee293d363642269d65911e46ed3be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:21Z,use_quota=True,user_id='edd5faa410354e6bbb01b37ae9de57cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e0528d-af2e-4a4a-a8e3-7802dc97a845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e0528d-af2e-4a4a-a8e3-7802dc97a845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6cb445-8ba2-46f8-aebf-009c20ee27f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6cb445-8ba2-46f8-aebf-009c20ee27f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '895a860b-0530-438a-8775-a141a94bc07d', 'volume_name': 'volume-895a860b-0530-438a-8775-a141a94bc07d', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe83116c-a1e2-4513-8bd5-bccd34f976ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe83116c-a1e2-4513-8bd5-bccd34f976ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89282807-744d-4ed0-96a1-4e6078e791ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:21 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Volume 895a860b-0530-438a-8775-a141a94bc07d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-895a860b-0530-438a-8775-a141a94bc07d', 'volume_size': 1} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:21 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e21bdb59-c800-453d-9caf-3bd7604fe120" returned: 0 in 0.751s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-quobyte-e21bdb59-c800-453d-9caf-3bd7604fe120" released by "delete_volume" :: held 2.319s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:21 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Flow 'volume_create_manager' (f3a38617-1336-436e-bce6-ca95ff5bf024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72e4810-58a8-4e2b-b80d-76033dcaf08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72e4810-58a8-4e2b-b80d-76033dcaf08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1347387401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d8c5ab4-21db-40be-9177-14a51aa48e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeee293d363642269d65911e46ed3be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:22Z,use_quota=True,user_id='edd5faa410354e6bbb01b37ae9de57cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b132a30-50c8-4e91-8d39-3921c338006b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b132a30-50c8-4e91-8d39-3921c338006b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b06fc36-db56-4e66-8711-3950e11953bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b06fc36-db56-4e66-8711-3950e11953bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d8c5ab4-21db-40be-9177-14a51aa48e69', 'volume_name': 'volume-7d8c5ab4-21db-40be-9177-14a51aa48e69', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4230fdd3-0ada-495c-8d4e-ea192aa3fead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4230fdd3-0ada-495c-8d4e-ea192aa3fead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84311e6-9fd7-46de-83c0-8af0a3750aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:22 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Volume 7d8c5ab4-21db-40be-9177-14a51aa48e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d8c5ab4-21db-40be-9177-14a51aa48e69', 'volume_size': 1} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] Created reservations ['2bb3527b-bfad-4482-b9b3-29cdfc315737', '57cc8e3c-7223-4af6-8fb9-ba1fbedadfd3', '2b99b71f-f0d0-44a9-a063-c563fd739392', 'a9075762-baeb-4482-b8e2-624d0cec4f8c'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e6f32cb8-dd62-4b2b-a45c-205c5df09710 1073741824" returned: 0 in 1.949s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Flow 'volume_create_manager' (0ef7c8fd-d1c3-4a6a-85a5-fc76367bb855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0af3179-804e-4a2d-9d1f-6409f74eee36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e6f32cb8-dd62-4b2b-a45c-205c5df09710 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0af3179-804e-4a2d-9d1f-6409f74eee36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2098002033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f53fa02-b188-4748-a965-bd87565609ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeee293d363642269d65911e46ed3be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:22Z,use_quota=True,user_id='edd5faa410354e6bbb01b37ae9de57cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46b88d5-d37f-46d9-9385-feef4bca7b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46b88d5-d37f-46d9-9385-feef4bca7b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:22 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e6f32cb8-dd62-4b2b-a45c-205c5df09710 Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f332766-b6ab-45df-97f2-5da9fdf14913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:22 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f332766-b6ab-45df-97f2-5da9fdf14913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f53fa02-b188-4748-a965-bd87565609ab', 'volume_name': 'volume-5f53fa02-b188-4748-a965-bd87565609ab', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f84a60-8346-49f0-8a87-b028385daa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f84a60-8346-49f0-8a87-b028385daa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf7ca5f-9a65-4081-bb7e-e4bb65e26e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:22 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Volume 5f53fa02-b188-4748-a965-bd87565609ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f53fa02-b188-4748-a965-bd87565609ab', 'volume_size': 1} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:22 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:22 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "cinder-5f91b072-04dd-4b05-98df-892514318dd8-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-5f91b072-04dd-4b05-98df-892514318dd8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "cinder-quobyte-5f91b072-04dd-4b05-98df-892514318dd8" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-quobyte-5f91b072-04dd-4b05-98df-892514318dd8" acquired by "delete_volume" :: waited 0.015s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0653790-8f38-47a9-9e80-a537fb323e66]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f91b072-04dd-4b05-98df-892514318dd8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:22 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f91b072-04dd-4b05-98df-892514318dd8 Apr 16 13:30:22 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:23 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Flow 'volume_create_manager' (fab8352c-2a0e-4eb6-8454-d7f6e66931a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99853793-a9d1-4882-b610-ee4b50e171c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:23 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e6f32cb8-dd62-4b2b-a45c-205c5df09710" returned: 0 in 0.996s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.921s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] <== create_volume: return (3276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.282s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.593s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1091041269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efc0110-2167-4b18-adbf-783cde2dc50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeee293d363642269d65911e46ed3be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:20Z,use_quota=True,user_id='edd5faa410354e6bbb01b37ae9de57cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Creating volume 8efc0110-2167-4b18-adbf-783cde2dc50f {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:23 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8efc0110-2167-4b18-adbf-783cde2dc50f 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99853793-a9d1-4882-b610-ee4b50e171c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2146323033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b61fbbb2-d698-4619-a87f-e2c06dd08c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0932647d5514fa582d96f0944c9afa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:23Z,use_quota=True,user_id='bae2b832c02e407b8e46f941c9bcce28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bea28b2-3fd7-42c3-aadb-35d8bb573d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bea28b2-3fd7-42c3-aadb-35d8bb573d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb3358f-70ad-47ac-932c-4b9f445a0101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb3358f-70ad-47ac-932c-4b9f445a0101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b61fbbb2-d698-4619-a87f-e2c06dd08c10', 'volume_name': 'volume-b61fbbb2-d698-4619-a87f-e2c06dd08c10', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:23 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8efc0110-2167-4b18-adbf-783cde2dc50f 1073741824 Apr 16 13:30:23 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d92644c-2e60-46af-8e0b-ade78d6b9b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d92644c-2e60-46af-8e0b-ade78d6b9b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588e7225-e0d0-4b2f-a4e8-1d6a33bf608b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:23 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Volume b61fbbb2-d698-4619-a87f-e2c06dd08c10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b61fbbb2-d698-4619-a87f-e2c06dd08c10', 'volume_size': 1} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:23 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] Deleted volume successfully. Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7dbc30a-2363-4114-816f-047b43535a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f32cb8-dd62-4b2b-a45c-205c5df09710', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2805e73c-ee31-43a9-99b0-d2d349b1fcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7660f9a8-cc02-4181-818f-354b324d55ec tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-e21bdb59-c800-453d-9caf-3bd7604fe120-delete_volume" released by "delete_volume" :: held 4.433s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:23 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Volume volume-e6f32cb8-dd62-4b2b-a45c-205c5df09710 (e6f32cb8-dd62-4b2b-a45c-205c5df09710): created successfully Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2805e73c-ee31-43a9-99b0-d2d349b1fcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Flow 'volume_create_manager' (8ea8abfd-c2a6-4451-8df7-25d51a755371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:23 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f91b072-04dd-4b05-98df-892514318dd8" returned: 0 in 0.755s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f91b072-04dd-4b05-98df-892514318dd8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:23 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-fb819557-c491-4574-ade1-70eff0aaefb8 tempest-CreateVolumesFromImageTest-558008575 None] Created volume successfully. Apr 16 13:30:23 devstack sudo[88363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f91b072-04dd-4b05-98df-892514318dd8 Apr 16 13:30:23 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:24 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f91b072-04dd-4b05-98df-892514318dd8" returned: 0 in 0.666s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-quobyte-5f91b072-04dd-4b05-98df-892514318dd8" released by "delete_volume" :: held 1.500s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:24 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8efc0110-2167-4b18-adbf-783cde2dc50f 1073741824" returned: 0 in 0.884s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] Created reservations ['f01f6f85-3a91-4604-a352-06d4f1c209be', '482dcedf-174b-4530-bbe7-3864869a2842', 'd5e32ac4-3b1c-49dc-a255-48d12444d0f8', '695f3249-29e7-4d73-8af4-66fb09f420a6'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8efc0110-2167-4b18-adbf-783cde2dc50f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:24 devstack sudo[88370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8efc0110-2167-4b18-adbf-783cde2dc50f Apr 16 13:30:24 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:24 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:24 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:24 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8efc0110-2167-4b18-adbf-783cde2dc50f" returned: 0 in 0.480s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.314s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-684017980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895a860b-0530-438a-8775-a141a94bc07d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeee293d363642269d65911e46ed3be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:21Z,use_quota=True,user_id='edd5faa410354e6bbb01b37ae9de57cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Creating volume 895a860b-0530-438a-8775-a141a94bc07d {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:24 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-895a860b-0530-438a-8775-a141a94bc07d 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:24 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-895a860b-0530-438a-8775-a141a94bc07d 1073741824 Apr 16 13:30:24 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9f791e-1f8a-4f06-8af9-da77d9d8bf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8efc0110-2167-4b18-adbf-783cde2dc50f', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce65a88b-683e-48ae-93d2-d8bc48017c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "cinder-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:24 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Volume volume-8efc0110-2167-4b18-adbf-783cde2dc50f (8efc0110-2167-4b18-adbf-783cde2dc50f): created successfully Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce65a88b-683e-48ae-93d2-d8bc48017c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Flow 'volume_create_manager' (9ae3c7da-5ac6-44ca-b39c-6ee0afc77e6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:24 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-53748800-5784-4ff4-b820-3e471564cdff tempest-CreateVolumesFromImageTest-558008575 None] Created volume successfully. Apr 16 13:30:25 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:25 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "cinder-quobyte-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.715s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:25 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:25 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] Deleted volume successfully. Apr 16 13:30:25 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-quobyte-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3" acquired by "delete_volume" :: waited 0.026s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:25 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3d851623-5889-42e5-a2c2-79d58779636c tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-5f91b072-04dd-4b05-98df-892514318dd8-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:25 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d51564f-a876-4045-8239-2966d5b03e50]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:25 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3 Apr 16 13:30:25 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:25 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3" returned: 0 in 0.538s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:25 devstack sudo[88386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3 Apr 16 13:30:25 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:25 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-895a860b-0530-438a-8775-a141a94bc07d 1073741824" returned: 0 in 0.888s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-895a860b-0530-438a-8775-a141a94bc07d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:25 devstack sudo[88388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-895a860b-0530-438a-8775-a141a94bc07d Apr 16 13:30:25 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:26 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3" returned: 0 in 0.515s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-quobyte-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3" released by "delete_volume" :: held 1.088s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] Created reservations ['f006f6f6-7c42-4525-ae2d-b0db4a4dcb22', '1580c2fd-5287-4bda-884b-3e0353a7245e', 'adfeffdc-5e12-42cd-8df2-24ef8a2f4159', '5e1671b1-0919-49f6-bd2b-a7ecc63f677b'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:26 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-895a860b-0530-438a-8775-a141a94bc07d" returned: 0 in 0.523s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.220s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1347387401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d8c5ab4-21db-40be-9177-14a51aa48e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeee293d363642269d65911e46ed3be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:22Z,use_quota=True,user_id='edd5faa410354e6bbb01b37ae9de57cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Creating volume 7d8c5ab4-21db-40be-9177-14a51aa48e69 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:26 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7d8c5ab4-21db-40be-9177-14a51aa48e69 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:26 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:26 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89282807-744d-4ed0-96a1-4e6078e791ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-895a860b-0530-438a-8775-a141a94bc07d', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49507e5-068f-403c-a551-4a4abfae1533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:26 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Volume volume-895a860b-0530-438a-8775-a141a94bc07d (895a860b-0530-438a-8775-a141a94bc07d): created successfully Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49507e5-068f-403c-a551-4a4abfae1533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Flow 'volume_create_manager' (25bd4799-c6f5-4feb-92ff-9faa4b7b0fe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:26 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-e51f9e69-ec2b-48ea-b28b-c4801c838d13 tempest-CreateVolumesFromImageTest-558008575 None] Created volume successfully. Apr 16 13:30:26 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7d8c5ab4-21db-40be-9177-14a51aa48e69 1073741824 Apr 16 13:30:26 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:26 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.562s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:26 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] Deleted volume successfully. Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-11cc028f-aa6a-4a5a-910f-a2da8770affa tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-2501bd8e-213d-4c0e-b5b3-0fbbc518e4d3-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:26 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7d8c5ab4-21db-40be-9177-14a51aa48e69 1073741824" returned: 0 in 0.733s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7d8c5ab4-21db-40be-9177-14a51aa48e69 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:27 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7d8c5ab4-21db-40be-9177-14a51aa48e69 Apr 16 13:30:27 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "cinder-e00445c5-1c2a-48c3-b0dd-c02307649022-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-e00445c5-1c2a-48c3-b0dd-c02307649022-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "cinder-quobyte-e00445c5-1c2a-48c3-b0dd-c02307649022" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-quobyte-e00445c5-1c2a-48c3-b0dd-c02307649022" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[66124b58-96f2-4957-b6ec-7b63ca19ecf0]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e00445c5-1c2a-48c3-b0dd-c02307649022 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:27 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e00445c5-1c2a-48c3-b0dd-c02307649022 Apr 16 13:30:27 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:27 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7d8c5ab4-21db-40be-9177-14a51aa48e69" returned: 0 in 0.457s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.069s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2098002033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f53fa02-b188-4748-a965-bd87565609ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeee293d363642269d65911e46ed3be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:22Z,use_quota=True,user_id='edd5faa410354e6bbb01b37ae9de57cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Creating volume 5f53fa02-b188-4748-a965-bd87565609ab {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:27 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f53fa02-b188-4748-a965-bd87565609ab 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:27 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f53fa02-b188-4748-a965-bd87565609ab 1073741824 Apr 16 13:30:27 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84311e6-9fd7-46de-83c0-8af0a3750aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d8c5ab4-21db-40be-9177-14a51aa48e69', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a637af2-0054-4ecc-a03b-3eb8a9123255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:27 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Volume volume-7d8c5ab4-21db-40be-9177-14a51aa48e69 (7d8c5ab4-21db-40be-9177-14a51aa48e69): created successfully Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a637af2-0054-4ecc-a03b-3eb8a9123255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Flow 'volume_create_manager' (f3a38617-1336-436e-bce6-ca95ff5bf024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:27 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-6ff43c48-adaa-452e-9061-7fbf188027d1 tempest-CreateVolumesFromImageTest-558008575 None] Created volume successfully. Apr 16 13:30:27 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e00445c5-1c2a-48c3-b0dd-c02307649022" returned: 0 in 0.533s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e00445c5-1c2a-48c3-b0dd-c02307649022 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:27 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e00445c5-1c2a-48c3-b0dd-c02307649022 Apr 16 13:30:27 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:28 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f53fa02-b188-4748-a965-bd87565609ab 1073741824" returned: 0 in 0.584s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f53fa02-b188-4748-a965-bd87565609ab {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:28 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f53fa02-b188-4748-a965-bd87565609ab Apr 16 13:30:28 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:28 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e00445c5-1c2a-48c3-b0dd-c02307649022" returned: 0 in 0.481s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-quobyte-e00445c5-1c2a-48c3-b0dd-c02307649022" released by "delete_volume" :: held 1.042s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] Created reservations ['2af1c687-b721-44fc-8837-cea1563bf53f', '39c232fe-47fd-40df-91cc-440c92232c1b', 'e7b0336a-6889-4518-a571-058aa436a7d4', 'ffc29d7f-cd3f-40c7-9df7-f51a283cdcbe'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:28 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:28 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:28 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f53fa02-b188-4748-a965-bd87565609ab" returned: 0 in 0.429s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.071s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2146323033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b61fbbb2-d698-4619-a87f-e2c06dd08c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0932647d5514fa582d96f0944c9afa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:23Z,use_quota=True,user_id='bae2b832c02e407b8e46f941c9bcce28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Creating volume b61fbbb2-d698-4619-a87f-e2c06dd08c10 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:28 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b61fbbb2-d698-4619-a87f-e2c06dd08c10 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf7ca5f-9a65-4081-bb7e-e4bb65e26e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f53fa02-b188-4748-a965-bd87565609ab', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:28 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b61fbbb2-d698-4619-a87f-e2c06dd08c10 1073741824 Apr 16 13:30:28 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (381ed394-42ef-433d-a8f1-ea1bf24c12ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:28 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Volume volume-5f53fa02-b188-4748-a965-bd87565609ab (5f53fa02-b188-4748-a965-bd87565609ab): created successfully Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (381ed394-42ef-433d-a8f1-ea1bf24c12ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Flow 'volume_create_manager' (0ef7c8fd-d1c3-4a6a-85a5-fc76367bb855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:28 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-13ff6649-7036-4ef4-a812-8cb2805f3d44 tempest-CreateVolumesFromImageTest-558008575 None] Created volume successfully. Apr 16 13:30:28 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.475s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:28 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] Deleted volume successfully. Apr 16 13:30:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7fe5c62e-8d96-4763-be10-92db16f04165 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-e00445c5-1c2a-48c3-b0dd-c02307649022-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "cinder-5f53fa02-b188-4748-a965-bd87565609ab-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-5f53fa02-b188-4748-a965-bd87565609ab-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "cinder-quobyte-5f53fa02-b188-4748-a965-bd87565609ab" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-quobyte-5f53fa02-b188-4748-a965-bd87565609ab" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca12aa6d-4590-417b-a128-8d0ac6dda33d]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f53fa02-b188-4748-a965-bd87565609ab {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:29 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b61fbbb2-d698-4619-a87f-e2c06dd08c10 1073741824" returned: 0 in 0.611s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b61fbbb2-d698-4619-a87f-e2c06dd08c10 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:29 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f53fa02-b188-4748-a965-bd87565609ab Apr 16 13:30:29 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:29 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b61fbbb2-d698-4619-a87f-e2c06dd08c10 Apr 16 13:30:29 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "cinder-5f1f5442-e108-4e59-8e55-085c884884c3-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-5f1f5442-e108-4e59-8e55-085c884884c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "cinder-quobyte-ef707c78-8d35-4a63-8f6c-f240e3d43fda" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-quobyte-ef707c78-8d35-4a63-8f6c-f240e3d43fda" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "cinder-quobyte-5f1f5442-e108-4e59-8e55-085c884884c3" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-quobyte-5f1f5442-e108-4e59-8e55-085c884884c3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] Deleting offline snapshot 5f1f5442-e108-4e59-8e55-085c884884c3 of volume ef707c78-8d35-4a63-8f6c-f240e3d43fda {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] snapshot_file for this snap is: volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cb7bc7-8fec-45a9-ab92-c2d5864d83d4]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:29 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3 Apr 16 13:30:29 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:29 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f53fa02-b188-4748-a965-bd87565609ab" returned: 0 in 0.516s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f53fa02-b188-4748-a965-bd87565609ab {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:29 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f53fa02-b188-4748-a965-bd87565609ab Apr 16 13:30:29 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:29 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b61fbbb2-d698-4619-a87f-e2c06dd08c10" returned: 0 in 0.490s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588e7225-e0d0-4b2f-a4e8-1d6a33bf608b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b61fbbb2-d698-4619-a87f-e2c06dd08c10', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d95fcf-5c45-4e7a-96c4-f54ad4a81292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:29 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Volume volume-b61fbbb2-d698-4619-a87f-e2c06dd08c10 (b61fbbb2-d698-4619-a87f-e2c06dd08c10): created successfully Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d95fcf-5c45-4e7a-96c4-f54ad4a81292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Flow 'volume_create_manager' (fab8352c-2a0e-4eb6-8454-d7f6e66931a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:29 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-ea36347d-81ce-474f-b7e6-0202d27873d4 tempest-AbsoluteLimitsTests-1850413059 None] Created volume successfully. Apr 16 13:30:29 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3" returned: 0 in 0.603s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04591ca-271c-4173-b033-f8923cd41242]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:30 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda Apr 16 13:30:30 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:30 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f53fa02-b188-4748-a965-bd87565609ab" returned: 0 in 0.446s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-quobyte-5f53fa02-b188-4748-a965-bd87565609ab" released by "delete_volume" :: held 0.989s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] Created reservations ['b0f9108a-b77e-4954-82f9-8ad8da6c531d', '6e409d5f-3e6e-4624-aece-9fb73cafaf8e', '6bb66a38-d808-4d14-bc27-2c0d391666bd', '6d411cd9-924f-41f9-9b8f-6f3faf7950bf'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:30 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:30 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:30 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda" returned: 0 in 0.542s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:30 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3 Apr 16 13:30:30 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:30 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.401s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:30 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] Deleted volume successfully. Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5f9792ad-d3e8-45ca-8147-9662dfa1a4ac tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-5f53fa02-b188-4748-a965-bd87565609ab-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] Acquiring lock "cinder-b61fbbb2-d698-4619-a87f-e2c06dd08c10-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] Lock "cinder-b61fbbb2-d698-4619-a87f-e2c06dd08c10-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] Acquiring lock "cinder-quobyte-b61fbbb2-d698-4619-a87f-e2c06dd08c10" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] Lock "cinder-quobyte-b61fbbb2-d698-4619-a87f-e2c06dd08c10" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbf2172-2ce5-4f92-ad4b-dd4fb9d0f2f8]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b61fbbb2-d698-4619-a87f-e2c06dd08c10 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:30 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3" returned: 0 in 0.508s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:31 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3 Apr 16 13:30:31 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:31 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b61fbbb2-d698-4619-a87f-e2c06dd08c10 Apr 16 13:30:31 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "cinder-7d8c5ab4-21db-40be-9177-14a51aa48e69-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-7d8c5ab4-21db-40be-9177-14a51aa48e69-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "cinder-quobyte-7d8c5ab4-21db-40be-9177-14a51aa48e69" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-quobyte-7d8c5ab4-21db-40be-9177-14a51aa48e69" acquired by "delete_volume" :: waited 0.021s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:31 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cd269b-552f-42ee-a345-6a0a11678faa]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7d8c5ab4-21db-40be-9177-14a51aa48e69 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:31 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda.5f1f5442-e108-4e59-8e55-085c884884c3" returned: 0 in 0.738s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:31 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7d8c5ab4-21db-40be-9177-14a51aa48e69 Apr 16 13:30:31 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-quobyte-5f1f5442-e108-4e59-8e55-085c884884c3" released by "_delete_snapshot" :: held 2.477s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-quobyte-ef707c78-8d35-4a63-8f6c-f240e3d43fda" released by "delete_snapshot" :: held 2.500s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:31 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] Created reservations ['4f5a6f0c-4610-412c-a2ac-95e1de3f95f9', '62b7c7b7-4a24-4419-949b-bb82b810dd56', '4099fc8f-0734-44f3-870c-b311c39f1b26', '2d0c0e83-22b8-4353-805e-98d096a0e59b'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:32 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] Delete snapshot completed successfully. Apr 16 13:30:32 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4cf88559-45ea-4f3f-aec4-50b5b3f3f1c8 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-5f1f5442-e108-4e59-8e55-085c884884c3-delete_snapshot" released by "delete_snapshot" :: held 2.781s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b61fbbb2-d698-4619-a87f-e2c06dd08c10" returned: 0 in 1.115s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b61fbbb2-d698-4619-a87f-e2c06dd08c10 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:32 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b61fbbb2-d698-4619-a87f-e2c06dd08c10 Apr 16 13:30:32 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "cinder-ef707c78-8d35-4a63-8f6c-f240e3d43fda-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-ef707c78-8d35-4a63-8f6c-f240e3d43fda-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "cinder-quobyte-ef707c78-8d35-4a63-8f6c-f240e3d43fda" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-quobyte-ef707c78-8d35-4a63-8f6c-f240e3d43fda" acquired by "delete_volume" :: waited 0.017s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[22aec26a-d932-4e7a-a994-d975ae75f1d8]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:32 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:32 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7d8c5ab4-21db-40be-9177-14a51aa48e69" returned: 0 in 1.268s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7d8c5ab4-21db-40be-9177-14a51aa48e69 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b61fbbb2-d698-4619-a87f-e2c06dd08c10" returned: 0 in 0.614s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] Lock "cinder-quobyte-b61fbbb2-d698-4619-a87f-e2c06dd08c10" released by "delete_volume" :: held 1.766s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:32 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda Apr 16 13:30:32 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:32 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7d8c5ab4-21db-40be-9177-14a51aa48e69 Apr 16 13:30:32 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] Created reservations ['e7c399da-2a52-4f2d-b9e7-b1e7a6e8c479', 'e8486317-3493-4b1f-ba5f-a83cd09ea9e5', '0d65b417-ca34-43cc-b0fb-03e473972124', '576c14d1-d645-4847-baf3-e4f31065c848'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:32 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:32 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:33 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda" returned: 0 in 0.778s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:33 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda Apr 16 13:30:33 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:34 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-7d8c5ab4-21db-40be-9177-14a51aa48e69" returned: 0 in 1.514s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-quobyte-7d8c5ab4-21db-40be-9177-14a51aa48e69" released by "delete_volume" :: held 2.824s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:34 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 1.318s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:34 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] Deleted volume successfully. Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-96bf1303-6439-4d55-958f-1990882f53ff tempest-AbsoluteLimitsTests-1850413059 None] Lock "cinder-b61fbbb2-d698-4619-a87f-e2c06dd08c10-delete_volume" released by "delete_volume" :: held 3.391s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] Created reservations ['05aa1499-3766-4811-9b8b-833b09595d90', 'acd8bd46-3a90-49fb-9331-58fcd348ccbb', '4bf89022-eebf-427a-a4a3-10b53b4fad4b', '32adcf52-f493-47f2-a763-0167b179e884'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:34 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:34 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG oslo_service.periodic_task [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83606) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:34 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ef707c78-8d35-4a63-8f6c-f240e3d43fda" returned: 0 in 1.135s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-quobyte-ef707c78-8d35-4a63-8f6c-f240e3d43fda" released by "delete_volume" :: held 1.996s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:34 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:34 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Created reservations ['a3a8ba53-bdd1-4125-9914-0d9ec1519c22', '896d46c0-e40b-41ec-9844-0e46d6561169', 'd06ade87-85e6-4ed3-bbe8-c0ddaae59a25', '4834953b-dbc8-4bb7-99de-17635349b746'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "cinder-895a860b-0530-438a-8775-a141a94bc07d-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Flow 'volume_create_manager' (947027e7-549a-4b08-8bd3-7a2eaf85f238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af732f8-6d29-4ad9-9087-5760cbd6b737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-895a860b-0530-438a-8775-a141a94bc07d-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:35 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af732f8-6d29-4ad9-9087-5760cbd6b737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1638623961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae85d15c-f576-4062-8dac-242f8a011be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f2aeb1f4cb4bb9b7ad3bf8bb108860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:35Z,use_quota=True,user_id='f0305d9f95fa4cf68d04d2eff949115d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093d5ac7-f5b5-4565-8ff3-b95e0e925965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:35 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093d5ac7-f5b5-4565-8ff3-b95e0e925965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22d7ef7-cfe3-473d-9ee0-7203e9cc2796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22d7ef7-cfe3-473d-9ee0-7203e9cc2796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae85d15c-f576-4062-8dac-242f8a011be0', 'volume_name': 'volume-ae85d15c-f576-4062-8dac-242f8a011be0', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054aa844-857c-4cd6-a4b8-3b6adbe8b5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054aa844-857c-4cd6-a4b8-3b6adbe8b5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f09c2f8-4844-4560-95a8-99f7b95684b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:35 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Volume ae85d15c-f576-4062-8dac-242f8a011be0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae85d15c-f576-4062-8dac-242f8a011be0', 'volume_size': 1} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1638623961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae85d15c-f576-4062-8dac-242f8a011be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f2aeb1f4cb4bb9b7ad3bf8bb108860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:35Z,use_quota=True,user_id='f0305d9f95fa4cf68d04d2eff949115d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Creating volume ae85d15c-f576-4062-8dac-242f8a011be0 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:35 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ae85d15c-f576-4062-8dac-242f8a011be0 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:35 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ae85d15c-f576-4062-8dac-242f8a011be0 1073741824 Apr 16 13:30:35 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "cinder-quobyte-895a860b-0530-438a-8775-a141a94bc07d" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-quobyte-895a860b-0530-438a-8775-a141a94bc07d" acquired by "delete_volume" :: waited 0.023s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b999e6-2b67-49c7-a8ab-fbad021bd193]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-895a860b-0530-438a-8775-a141a94bc07d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:35 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-895a860b-0530-438a-8775-a141a94bc07d Apr 16 13:30:35 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:35 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 1.217s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:35 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] Deleted volume successfully. Apr 16 13:30:35 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 1.158s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:35 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-ca0d5e31-3362-4492-a9e7-f02aabd1b2da tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-7d8c5ab4-21db-40be-9177-14a51aa48e69-delete_volume" released by "delete_volume" :: held 4.426s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:36 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 1.423s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:36 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:36 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Deleted volume successfully. Apr 16 13:30:36 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4405ec5f-15de-4cd3-966b-40cb9c91bdd6 tempest-CreateVolumesFromSnapshotTest-431307883 None] Lock "cinder-ef707c78-8d35-4a63-8f6c-f240e3d43fda-delete_volume" released by "delete_volume" :: held 3.920s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:36 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ae85d15c-f576-4062-8dac-242f8a011be0 1073741824" returned: 0 in 1.575s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ae85d15c-f576-4062-8dac-242f8a011be0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:36 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-895a860b-0530-438a-8775-a141a94bc07d" returned: 0 in 1.481s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-895a860b-0530-438a-8775-a141a94bc07d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:36 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ae85d15c-f576-4062-8dac-242f8a011be0 Apr 16 13:30:36 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:36 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-895a860b-0530-438a-8775-a141a94bc07d Apr 16 13:30:36 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:37 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-895a860b-0530-438a-8775-a141a94bc07d" returned: 0 in 0.844s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-quobyte-895a860b-0530-438a-8775-a141a94bc07d" released by "delete_volume" :: held 2.379s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:37 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] Created reservations ['87b8fdc7-3c72-4453-b02b-e412477a64c2', '230e5f0b-65dd-41af-87a7-dd49722cd79d', 'ff487b06-0192-4c2e-8b79-ce6cfc05473c', 'b9e5a447-a8b0-4b09-a67e-c77d87c25d2a'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:37 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ae85d15c-f576-4062-8dac-242f8a011be0" returned: 0 in 1.034s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] <== create_volume: return (2642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.649s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f09c2f8-4844-4560-95a8-99f7b95684b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae85d15c-f576-4062-8dac-242f8a011be0', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f7d5d3-f326-4ffa-ac04-8b9b7c01a713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:37 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Volume volume-ae85d15c-f576-4062-8dac-242f8a011be0 (ae85d15c-f576-4062-8dac-242f8a011be0): created successfully Apr 16 13:30:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f7d5d3-f326-4ffa-ac04-8b9b7c01a713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Flow 'volume_create_manager' (947027e7-549a-4b08-8bd3-7a2eaf85f238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:37 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-c5ce4441-839c-4178-8900-defa535c0941 tempest-ServerRescueNegativeTestJSON-1249032403 None] Created volume successfully. Apr 16 13:30:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:37 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:37 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:38 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "cinder-8efc0110-2167-4b18-adbf-783cde2dc50f-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:38 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-8efc0110-2167-4b18-adbf-783cde2dc50f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:38 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "cinder-quobyte-8efc0110-2167-4b18-adbf-783cde2dc50f" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:38 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-quobyte-8efc0110-2167-4b18-adbf-783cde2dc50f" acquired by "delete_volume" :: waited 0.020s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:38 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6a76cc-2e14-4da9-b91a-bad3fbb7c469]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8efc0110-2167-4b18-adbf-783cde2dc50f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:38 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8efc0110-2167-4b18-adbf-783cde2dc50f Apr 16 13:30:38 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:39 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 1.099s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:39 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] Deleted volume successfully. Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-01bd7333-38fd-45b8-b2f7-50bff9f540f0 tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-895a860b-0530-438a-8775-a141a94bc07d-delete_volume" released by "delete_volume" :: held 4.071s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:39 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Flow 'volume_create_manager' (09d2d71e-2065-4d49-9bfc-27b414a135cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b784189-339e-49e2-b9d5-71a87cee895d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8efc0110-2167-4b18-adbf-783cde2dc50f" returned: 0 in 1.209s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8efc0110-2167-4b18-adbf-783cde2dc50f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:39 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8efc0110-2167-4b18-adbf-783cde2dc50f Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b784189-339e-49e2-b9d5-71a87cee895d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-775078621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f628fef-3865-4139-ad4b-0586359125e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc26fb6cc74e4f43bd61e106d20a3296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:40Z,use_quota=True,user_id='7136b620987c4b90b04c667c543f0f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:39 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb638c5-e320-4f34-b22f-e4a57be0a0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb638c5-e320-4f34-b22f-e4a57be0a0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d8af02-af8f-4f0f-aac7-7bbc9b64d929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d8af02-af8f-4f0f-aac7-7bbc9b64d929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f628fef-3865-4139-ad4b-0586359125e8', 'volume_name': 'volume-3f628fef-3865-4139-ad4b-0586359125e8', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13106be-df89-44c0-bf72-17e45088e82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13106be-df89-44c0-bf72-17e45088e82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97548e2-e3e0-4ae5-b13e-bba52204564f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:39 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume 3f628fef-3865-4139-ad4b-0586359125e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f628fef-3865-4139-ad4b-0586359125e8', 'volume_size': 1} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-775078621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f628fef-3865-4139-ad4b-0586359125e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc26fb6cc74e4f43bd61e106d20a3296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:40Z,use_quota=True,user_id='7136b620987c4b90b04c667c543f0f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Creating volume 3f628fef-3865-4139-ad4b-0586359125e8 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:39 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3f628fef-3865-4139-ad4b-0586359125e8 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:39 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3f628fef-3865-4139-ad4b-0586359125e8 1073741824 Apr 16 13:30:39 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:40 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Flow 'volume_create_manager' (c6b0734a-efe2-4f42-a914-7e78402ac71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bccf21c-8b7f-4179-baaf-b6ec61da0648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-8efc0110-2167-4b18-adbf-783cde2dc50f" returned: 0 in 0.908s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bccf21c-8b7f-4179-baaf-b6ec61da0648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1392950423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd0b9a40f3da4f6db536fc4b8d792eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:41Z,use_quota=True,user_id='ecd0e95096aa4bc8a7000ef6db1b0d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0507d96d-bb2c-408a-ab3e-b901d016eca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0507d96d-bb2c-408a-ab3e-b901d016eca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c08913e-57e4-4418-988b-36d267db786b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c08913e-57e4-4418-988b-36d267db786b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c', 'volume_name': 'volume-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ed47a3-db1c-4a41-bcd2-5ca63a6827e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ed47a3-db1c-4a41-bcd2-5ca63a6827e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1283d79c-5c1b-4b3d-b240-5fa86a8f78b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:40 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Volume 1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c', 'volume_size': 1} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-quobyte-8efc0110-2167-4b18-adbf-783cde2dc50f" released by "delete_volume" :: held 2.229s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] Created reservations ['f4593b4c-6de3-4d0b-b3b6-5cc162284730', '889fa2a9-7cf3-4337-adb2-178bd65bc132', '34e7f2cc-0c6c-4fc4-9b17-a54f6f3e6b52', '9cca41c9-b5a9-4c22-8565-a8ba76432560'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:40 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:40 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:40 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3f628fef-3865-4139-ad4b-0586359125e8 1073741824" returned: 0 in 1.052s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3f628fef-3865-4139-ad4b-0586359125e8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:40 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3f628fef-3865-4139-ad4b-0586359125e8 Apr 16 13:30:40 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:41 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.485s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:41 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] Deleted volume successfully. Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-40941900-d896-4ade-a9b4-8be941040af6 tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-8efc0110-2167-4b18-adbf-783cde2dc50f-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:41 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3f628fef-3865-4139-ad4b-0586359125e8" returned: 0 in 0.554s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.777s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1392950423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd0b9a40f3da4f6db536fc4b8d792eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:41Z,use_quota=True,user_id='ecd0e95096aa4bc8a7000ef6db1b0d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Creating volume 1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:41 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97548e2-e3e0-4ae5-b13e-bba52204564f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f628fef-3865-4139-ad4b-0586359125e8', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (750a6230-b09c-48ac-9909-cc4275398449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:41 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c 1073741824 Apr 16 13:30:41 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:41 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume volume-3f628fef-3865-4139-ad4b-0586359125e8 (3f628fef-3865-4139-ad4b-0586359125e8): created successfully Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (750a6230-b09c-48ac-9909-cc4275398449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Flow 'volume_create_manager' (09d2d71e-2065-4d49-9bfc-27b414a135cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:41 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-40cb1c3d-b5a5-46cf-b284-7580b3fbd570 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Created volume successfully. Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "cinder-e6f32cb8-dd62-4b2b-a45c-205c5df09710-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-e6f32cb8-dd62-4b2b-a45c-205c5df09710-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "cinder-quobyte-e6f32cb8-dd62-4b2b-a45c-205c5df09710" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-quobyte-e6f32cb8-dd62-4b2b-a45c-205c5df09710" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e19c6c-6645-43d2-9c1a-8587ba9b3e4b]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e6f32cb8-dd62-4b2b-a45c-205c5df09710 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:41 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e6f32cb8-dd62-4b2b-a45c-205c5df09710 Apr 16 13:30:41 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Flow 'volume_create_manager' (3e8ad4f5-5c6d-4769-831e-95ea3cd23fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce8dacc-70d8-4606-a86b-8bee1ee7e041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce8dacc-70d8-4606-a86b-8bee1ee7e041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1375348129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f954993-e335-4dd5-8fd1-55aa5520490c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc26fb6cc74e4f43bd61e106d20a3296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:42Z,use_quota=True,user_id='7136b620987c4b90b04c667c543f0f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dcddf28-1001-4b54-8afa-bc50335f92ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dcddf28-1001-4b54-8afa-bc50335f92ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf37ad68-41a5-4238-a5e8-e3581cba6585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf37ad68-41a5-4238-a5e8-e3581cba6585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f954993-e335-4dd5-8fd1-55aa5520490c', 'volume_name': 'volume-5f954993-e335-4dd5-8fd1-55aa5520490c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14dbe6e-f519-4e27-8921-cfefccf22ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14dbe6e-f519-4e27-8921-cfefccf22ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d75631c-1862-40e4-b32b-c8562f8b2cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:42 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume 5f954993-e335-4dd5-8fd1-55aa5520490c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f954993-e335-4dd5-8fd1-55aa5520490c', 'volume_size': 1} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:42 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c 1073741824" returned: 0 in 0.802s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:42 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c Apr 16 13:30:42 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Flow 'volume_create_manager' (df1fb333-c852-462b-9aae-ba8c7e269d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c303f3-6932-4c68-bf5e-09cd0f7b05ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c303f3-6932-4c68-bf5e-09cd0f7b05ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-150556431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc26fb6cc74e4f43bd61e106d20a3296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:42Z,use_quota=True,user_id='7136b620987c4b90b04c667c543f0f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e27f29-01c0-44de-8d7f-69ffa5387738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e27f29-01c0-44de-8d7f-69ffa5387738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2bdf68-b626-469c-b8be-0e16b9dbd846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2bdf68-b626-469c-b8be-0e16b9dbd846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46', 'volume_name': 'volume-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ead104-89d3-46ff-a0f0-b11cee1112ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ead104-89d3-46ff-a0f0-b11cee1112ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da79308-3429-4a7d-a037-b1dd128f5682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:42 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46', 'volume_size': 1} Apr 16 13:30:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Flow 'volume_create_manager' (6c9601db-684b-4d5a-a0cc-a19dd8cc35d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9315c25-edfe-4af7-93af-f4451532ab8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9315c25-edfe-4af7-93af-f4451532ab8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-812244751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394d716d-7d1c-4a60-90bf-04246a969803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc26fb6cc74e4f43bd61e106d20a3296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:43Z,use_quota=True,user_id='7136b620987c4b90b04c667c543f0f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:43 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c89bd3-7c9a-4f92-b745-d58717a659c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c89bd3-7c9a-4f92-b745-d58717a659c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ef77b6-38ed-47cb-b6eb-a94d48eea91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ef77b6-38ed-47cb-b6eb-a94d48eea91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '394d716d-7d1c-4a60-90bf-04246a969803', 'volume_name': 'volume-394d716d-7d1c-4a60-90bf-04246a969803', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3363e6d7-edaa-4c24-8745-b5f57b4e3a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3363e6d7-edaa-4c24-8745-b5f57b4e3a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a4d360-6da8-478f-88f1-339d0f11c7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:43 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume 394d716d-7d1c-4a60-90bf-04246a969803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-394d716d-7d1c-4a60-90bf-04246a969803', 'volume_size': 1} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e6f32cb8-dd62-4b2b-a45c-205c5df09710" returned: 0 in 1.304s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e6f32cb8-dd62-4b2b-a45c-205c5df09710 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:43 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e6f32cb8-dd62-4b2b-a45c-205c5df09710 Apr 16 13:30:43 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:43 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Flow 'volume_create_manager' (c7420d28-c28f-4215-9cd2-d2b15e64e64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3906baa9-60d2-451a-804a-b668c1c3d4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c" returned: 0 in 0.982s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.102s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1375348129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f954993-e335-4dd5-8fd1-55aa5520490c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc26fb6cc74e4f43bd61e106d20a3296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:42Z,use_quota=True,user_id='7136b620987c4b90b04c667c543f0f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Creating volume 5f954993-e335-4dd5-8fd1-55aa5520490c {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:43 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f954993-e335-4dd5-8fd1-55aa5520490c 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3906baa9-60d2-451a-804a-b668c1c3d4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1378017715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc26fb6cc74e4f43bd61e106d20a3296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:43Z,use_quota=True,user_id='7136b620987c4b90b04c667c543f0f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6fcea68-4394-461b-ac57-f26f2a66c6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6fcea68-4394-461b-ac57-f26f2a66c6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae0294a-f05d-4b66-a29f-69918550d8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:43 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f954993-e335-4dd5-8fd1-55aa5520490c 1073741824 Apr 16 13:30:43 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae0294a-f05d-4b66-a29f-69918550d8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c', 'volume_name': 'volume-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5622b00a-75ed-40a2-b7c9-8d3cb11b0091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5622b00a-75ed-40a2-b7c9-8d3cb11b0091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d46c89c-b93e-40b7-9c42-9860aeeee92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:43 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume 3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c', 'volume_size': 1} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1283d79c-5c1b-4b3d-b240-5fa86a8f78b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10d8cd8-3e72-4542-928e-81aea31bc46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:43 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Volume volume-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c (1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c): created successfully Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10d8cd8-3e72-4542-928e-81aea31bc46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Flow 'volume_create_manager' (c6b0734a-efe2-4f42-a914-7e78402ac71c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:43 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-27db9e78-26ee-48db-953a-6ae75a86c5fa tempest-VolumesTransfersTest-363722941 None] Created volume successfully. Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Flow 'volume_create_manager' (9ed11f26-5209-4473-8900-3988e914a13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb817cc8-a9cb-4212-b7e6-b2c3a2301fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb817cc8-a9cb-4212-b7e6-b2c3a2301fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1381381128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04632a6-7542-42f4-afeb-9069285177ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc26fb6cc74e4f43bd61e106d20a3296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:43Z,use_quota=True,user_id='7136b620987c4b90b04c667c543f0f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d038b9-24e5-46f0-bac5-551b113c9625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d038b9-24e5-46f0-bac5-551b113c9625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db848d21-63d7-4972-93b0-9cf00b8e4e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db848d21-63d7-4972-93b0-9cf00b8e4e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a04632a6-7542-42f4-afeb-9069285177ef', 'volume_name': 'volume-a04632a6-7542-42f4-afeb-9069285177ef', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5459644d-e926-459b-a861-c290da6507c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5459644d-e926-459b-a861-c290da6507c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512f5e47-2b2f-414d-b61f-f76963892d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:43 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume a04632a6-7542-42f4-afeb-9069285177ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a04632a6-7542-42f4-afeb-9069285177ef', 'volume_size': 1} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:43 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e6f32cb8-dd62-4b2b-a45c-205c5df09710" returned: 0 in 0.672s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-quobyte-e6f32cb8-dd62-4b2b-a45c-205c5df09710" released by "delete_volume" :: held 2.006s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] Created reservations ['a9aff2bc-481c-4091-b422-2e3be21baa0e', '12ef825d-29ac-41b0-94a9-e4d297166b22', '703ca93d-11d3-404e-bfef-b75932edb380', 'e260f092-a2f9-4519-9bd4-5b9539589e96'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:43 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:43 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:44 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f954993-e335-4dd5-8fd1-55aa5520490c 1073741824" returned: 0 in 0.881s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f954993-e335-4dd5-8fd1-55aa5520490c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:44 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f954993-e335-4dd5-8fd1-55aa5520490c Apr 16 13:30:44 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:44 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-8f55f1fa-1e61-43a9-b12c-622ea9cbd24d tempest-VolumesTransfersTest-1930841371 None] Transfer volume completed successfully. Apr 16 13:30:44 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.898s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:44 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:44 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] Deleted volume successfully. Apr 16 13:30:44 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e665432e-803c-4aaa-a777-9aa18f0577f8 tempest-CreateVolumesFromImageTest-558008575 None] Lock "cinder-e6f32cb8-dd62-4b2b-a45c-205c5df09710-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:44 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f954993-e335-4dd5-8fd1-55aa5520490c" returned: 0 in 0.718s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.365s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-150556431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc26fb6cc74e4f43bd61e106d20a3296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:42Z,use_quota=True,user_id='7136b620987c4b90b04c667c543f0f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Creating volume ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:44 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:45 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d75631c-1862-40e4-b32b-c8562f8b2cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f954993-e335-4dd5-8fd1-55aa5520490c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:45 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4fa6e7-2e2f-4cad-968d-3641d339cb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:45 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume volume-5f954993-e335-4dd5-8fd1-55aa5520490c (5f954993-e335-4dd5-8fd1-55aa5520490c): created successfully Apr 16 13:30:45 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4fa6e7-2e2f-4cad-968d-3641d339cb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:45 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46 1073741824 Apr 16 13:30:45 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Flow 'volume_create_manager' (3e8ad4f5-5c6d-4769-831e-95ea3cd23fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:45 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:45 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-90ba80ed-9e70-429b-b7ab-986ec3c94fdc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Created volume successfully. Apr 16 13:30:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] Acquiring lock "cinder-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] Lock "cinder-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] Acquiring lock "cinder-quobyte-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] Lock "cinder-quobyte-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:45 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[77322437-e3f0-4614-bed8-00c4c1ede4f2]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:45 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46 1073741824" returned: 0 in 0.639s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:45 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c Apr 16 13:30:45 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:45 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46 Apr 16 13:30:45 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:46 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c" returned: 0 in 0.557s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:46 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c Apr 16 13:30:46 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:46 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46" returned: 0 in 0.556s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.051s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-812244751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394d716d-7d1c-4a60-90bf-04246a969803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc26fb6cc74e4f43bd61e106d20a3296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:43Z,use_quota=True,user_id='7136b620987c4b90b04c667c543f0f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Creating volume 394d716d-7d1c-4a60-90bf-04246a969803 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:46 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-394d716d-7d1c-4a60-90bf-04246a969803 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da79308-3429-4a7d-a037-b1dd128f5682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13952cd7-ccc0-48cb-b0f6-92d052be6165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:46 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-394d716d-7d1c-4a60-90bf-04246a969803 1073741824 Apr 16 13:30:46 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:46 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume volume-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46 (ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46): created successfully Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13952cd7-ccc0-48cb-b0f6-92d052be6165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Flow 'volume_create_manager' (df1fb333-c852-462b-9aae-ba8c7e269d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:46 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-58a801ad-1298-4b36-bfa3-1934d6392f29 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Created volume successfully. Apr 16 13:30:46 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c" returned: 0 in 0.414s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] Lock "cinder-quobyte-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c" released by "delete_volume" :: held 0.995s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] Created reservations ['e27ccf84-e7ce-4f1f-9536-afe5cb6050b7', '67e02215-2fc2-40fe-9f97-22b901ba7593', '2cb7680e-6825-475a-bf7d-25beb5b6cb03', '358a7bc7-81bc-4e3f-99d3-34f16cc044a3'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:46 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:46 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:46 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-394d716d-7d1c-4a60-90bf-04246a969803 1073741824" returned: 0 in 0.564s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-394d716d-7d1c-4a60-90bf-04246a969803 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:46 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-394d716d-7d1c-4a60-90bf-04246a969803 Apr 16 13:30:46 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:47 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.443s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:47 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] Deleted volume successfully. Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-727d2fbe-0c12-4d10-80c7-40a2aa7d5286 tempest-VolumesTransfersTest-814934749 None] Lock "cinder-1c16cf7e-cd28-4a85-b0b5-fb0e6794e40c-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:47 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-394d716d-7d1c-4a60-90bf-04246a969803" returned: 0 in 0.468s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.862s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1378017715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc26fb6cc74e4f43bd61e106d20a3296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:43Z,use_quota=True,user_id='7136b620987c4b90b04c667c543f0f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Creating volume 3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:47 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a4d360-6da8-478f-88f1-339d0f11c7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-394d716d-7d1c-4a60-90bf-04246a969803', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:47 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c 1073741824 Apr 16 13:30:47 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1372c668-039d-4720-acfd-c6051524cbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:47 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume volume-394d716d-7d1c-4a60-90bf-04246a969803 (394d716d-7d1c-4a60-90bf-04246a969803): created successfully Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1372c668-039d-4720-acfd-c6051524cbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Flow 'volume_create_manager' (6c9601db-684b-4d5a-a0cc-a19dd8cc35d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:47 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-ce2382ad-1fe6-42d1-b83e-e39bab84f3fc tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Created volume successfully. Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Flow 'volume_create_manager' (8db89881-6af2-4af7-9195-a5b26a4f45df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a8d5b2-779e-4d97-b5d1-21d3cbf05f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:48 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c 1073741824" returned: 0 in 0.905s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a8d5b2-779e-4d97-b5d1-21d3cbf05f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-140972907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31831ab-739f-491b-b1c6-e83c872423f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd0b9a40f3da4f6db536fc4b8d792eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:48Z,use_quota=True,user_id='ecd0e95096aa4bc8a7000ef6db1b0d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cee0f94-101f-4d58-9707-09e00e258f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cee0f94-101f-4d58-9707-09e00e258f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068bd2c9-2a06-4c96-b569-a30d866cdff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068bd2c9-2a06-4c96-b569-a30d866cdff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b31831ab-739f-491b-b1c6-e83c872423f8', 'volume_name': 'volume-b31831ab-739f-491b-b1c6-e83c872423f8', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c87280b-74f9-4390-b1a5-cefb015db253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c87280b-74f9-4390-b1a5-cefb015db253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eef674a-1c6b-4775-9dcf-20ff00b13727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:48 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Volume b31831ab-739f-491b-b1c6-e83c872423f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b31831ab-739f-491b-b1c6-e83c872423f8', 'volume_size': 1} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:48 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c Apr 16 13:30:48 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:48 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c" returned: 0 in 0.472s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.173s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1381381128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04632a6-7542-42f4-afeb-9069285177ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc26fb6cc74e4f43bd61e106d20a3296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:43Z,use_quota=True,user_id='7136b620987c4b90b04c667c543f0f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Creating volume a04632a6-7542-42f4-afeb-9069285177ef {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:48 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a04632a6-7542-42f4-afeb-9069285177ef 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d46c89c-b93e-40b7-9c42-9860aeeee92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfa2288-b19f-48fb-b48f-c70a09bfdbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:48 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume volume-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c (3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c): created successfully Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfa2288-b19f-48fb-b48f-c70a09bfdbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Flow 'volume_create_manager' (c7420d28-c28f-4215-9cd2-d2b15e64e64c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:48 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a04632a6-7542-42f4-afeb-9069285177ef 1073741824 Apr 16 13:30:48 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:48 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-b53e0612-0c64-4e64-9738-ee0833afbe75 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Created volume successfully. Apr 16 13:30:49 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a04632a6-7542-42f4-afeb-9069285177ef 1073741824" returned: 0 in 0.606s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a04632a6-7542-42f4-afeb-9069285177ef {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:49 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a04632a6-7542-42f4-afeb-9069285177ef Apr 16 13:30:49 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:49 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a04632a6-7542-42f4-afeb-9069285177ef" returned: 0 in 0.426s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.560s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-140972907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31831ab-739f-491b-b1c6-e83c872423f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd0b9a40f3da4f6db536fc4b8d792eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:30:48Z,use_quota=True,user_id='ecd0e95096aa4bc8a7000ef6db1b0d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Creating volume b31831ab-739f-491b-b1c6-e83c872423f8 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:30:49 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b31831ab-739f-491b-b1c6-e83c872423f8 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:49 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b31831ab-739f-491b-b1c6-e83c872423f8 1073741824 Apr 16 13:30:49 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512f5e47-2b2f-414d-b61f-f76963892d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a04632a6-7542-42f4-afeb-9069285177ef', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415737cf-3a76-44fe-b212-27d3bfa994db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:49 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Volume volume-a04632a6-7542-42f4-afeb-9069285177ef (a04632a6-7542-42f4-afeb-9069285177ef): created successfully Apr 16 13:30:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415737cf-3a76-44fe-b212-27d3bfa994db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:50 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Flow 'volume_create_manager' (9ed11f26-5209-4473-8900-3988e914a13b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:50 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-9dc4c3f1-50c0-4e5f-8e83-53efb71377d6 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Created volume successfully. Apr 16 13:30:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "cinder-a04632a6-7542-42f4-afeb-9069285177ef-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-a04632a6-7542-42f4-afeb-9069285177ef-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "cinder-quobyte-a04632a6-7542-42f4-afeb-9069285177ef" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-quobyte-a04632a6-7542-42f4-afeb-9069285177ef" acquired by "delete_volume" :: waited 0.016s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:50 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[888d51ab-2043-4070-99ae-6edae9340378]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a04632a6-7542-42f4-afeb-9069285177ef {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:50 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a04632a6-7542-42f4-afeb-9069285177ef Apr 16 13:30:50 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:50 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b31831ab-739f-491b-b1c6-e83c872423f8 1073741824" returned: 0 in 0.736s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b31831ab-739f-491b-b1c6-e83c872423f8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:50 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b31831ab-739f-491b-b1c6-e83c872423f8 Apr 16 13:30:50 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:50 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a04632a6-7542-42f4-afeb-9069285177ef" returned: 0 in 0.575s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a04632a6-7542-42f4-afeb-9069285177ef {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:50 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a04632a6-7542-42f4-afeb-9069285177ef Apr 16 13:30:50 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:51 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b31831ab-739f-491b-b1c6-e83c872423f8" returned: 0 in 0.429s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eef674a-1c6b-4775-9dcf-20ff00b13727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b31831ab-739f-491b-b1c6-e83c872423f8', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405e33a4-aac7-4aa1-b1a5-e1a95e972ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:30:51 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Volume volume-b31831ab-739f-491b-b1c6-e83c872423f8 (b31831ab-739f-491b-b1c6-e83c872423f8): created successfully Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405e33a4-aac7-4aa1-b1a5-e1a95e972ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Flow 'volume_create_manager' (8db89881-6af2-4af7-9195-a5b26a4f45df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:30:51 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-f42b3a20-1244-4466-98c1-aa1993b7bb1a tempest-VolumesTransfersTest-363722941 None] Created volume successfully. Apr 16 13:30:51 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a04632a6-7542-42f4-afeb-9069285177ef" returned: 0 in 0.635s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-quobyte-a04632a6-7542-42f4-afeb-9069285177ef" released by "delete_volume" :: held 1.270s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Created reservations ['c9fa7382-2a64-4b94-9b66-1cf6e3579fc6', '27f1f5c8-6c4b-442c-a97e-5df272acac11', '8817d218-1fc5-4fc3-986b-202b3cee9fe6', 'f00f94c9-eff1-44eb-8fef-8292cff064f5'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:51 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:51 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] Acquiring lock "cinder-b31831ab-739f-491b-b1c6-e83c872423f8-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] Lock "cinder-b31831ab-739f-491b-b1c6-e83c872423f8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] Acquiring lock "cinder-quobyte-b31831ab-739f-491b-b1c6-e83c872423f8" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] Lock "cinder-quobyte-b31831ab-739f-491b-b1c6-e83c872423f8" acquired by "delete_volume" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba426d60-9ca4-40db-b04d-7e6bec8371a9]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b31831ab-739f-491b-b1c6-e83c872423f8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:51 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b31831ab-739f-491b-b1c6-e83c872423f8 Apr 16 13:30:51 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:52 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.634s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:52 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:52 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Deleted volume successfully. Apr 16 13:30:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-70cf6f25-2f71-41b5-acb2-d1cfe2050f21 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-a04632a6-7542-42f4-afeb-9069285177ef-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "cinder-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "cinder-quobyte-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-quobyte-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:52 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea111fce-10be-42ac-ada7-a0d680432407]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:52 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b31831ab-739f-491b-b1c6-e83c872423f8" returned: 0 in 0.892s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b31831ab-739f-491b-b1c6-e83c872423f8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:52 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c Apr 16 13:30:52 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:52 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b31831ab-739f-491b-b1c6-e83c872423f8 Apr 16 13:30:52 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:53 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c" returned: 0 in 0.687s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:53 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b31831ab-739f-491b-b1c6-e83c872423f8" returned: 0 in 0.561s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] Lock "cinder-quobyte-b31831ab-739f-491b-b1c6-e83c872423f8" released by "delete_volume" :: held 1.481s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:53 devstack sudo[88858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c Apr 16 13:30:53 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] Created reservations ['98d9b61e-0bde-4d4c-a6ee-e0a494a19d54', 'e7dfd121-2328-451c-9287-8b6f05924b08', '88a00417-24bc-4c37-9a01-75ccc5c7bda5', '26769b0b-9b3f-4c3e-9adf-3b1b98d56aa3'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:53 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:53 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:53 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.432s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:53 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] Deleted volume successfully. Apr 16 13:30:53 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c" returned: 0 in 0.553s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-quobyte-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c" released by "delete_volume" :: held 1.294s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-86998112-d56b-4622-ba81-29c9bda126c0 tempest-VolumesTransfersTest-814934749 None] Lock "cinder-b31831ab-739f-491b-b1c6-e83c872423f8-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Created reservations ['30d2a8a5-9de5-4fb7-a9e1-afff47925acc', '313ac03e-98cd-4a2e-b99e-d920ce300060', '197a0138-bc00-49ff-939d-a0bd8ff47a25', 'da401188-b88c-4be4-8521-35f36e4fe13b'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:54 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:54 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] Acquiring lock "cinder-ae85d15c-f576-4062-8dac-242f8a011be0-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] Lock "cinder-ae85d15c-f576-4062-8dac-242f8a011be0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] Acquiring lock "cinder-quobyte-ae85d15c-f576-4062-8dac-242f8a011be0" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] Lock "cinder-quobyte-ae85d15c-f576-4062-8dac-242f8a011be0" acquired by "delete_volume" :: waited 0.024s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:54 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb7905f-7241-4643-a2fe-f39982679448]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ae85d15c-f576-4062-8dac-242f8a011be0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:54 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ae85d15c-f576-4062-8dac-242f8a011be0 Apr 16 13:30:54 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:54 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.629s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:54 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:54 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Deleted volume successfully. Apr 16 13:30:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3777f811-744c-403c-91d9-4430c3b86125 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-3d33bf0c-ed5e-42d7-8e6b-1057e9511b1c-delete_volume" released by "delete_volume" :: held 2.106s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "cinder-394d716d-7d1c-4a60-90bf-04246a969803-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-394d716d-7d1c-4a60-90bf-04246a969803-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "cinder-quobyte-394d716d-7d1c-4a60-90bf-04246a969803" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-quobyte-394d716d-7d1c-4a60-90bf-04246a969803" acquired by "delete_volume" :: waited 0.023s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:55 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ae85d15c-f576-4062-8dac-242f8a011be0" returned: 0 in 0.749s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ae85d15c-f576-4062-8dac-242f8a011be0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:55 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64028e2-ccc9-419c-b5fc-779797a2b244]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-394d716d-7d1c-4a60-90bf-04246a969803 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:55 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ae85d15c-f576-4062-8dac-242f8a011be0 Apr 16 13:30:55 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:55 devstack sudo[88875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-394d716d-7d1c-4a60-90bf-04246a969803 Apr 16 13:30:55 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:55 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ae85d15c-f576-4062-8dac-242f8a011be0" returned: 0 in 0.632s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] Lock "cinder-quobyte-ae85d15c-f576-4062-8dac-242f8a011be0" released by "delete_volume" :: held 1.439s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:55 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-394d716d-7d1c-4a60-90bf-04246a969803" returned: 0 in 0.676s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-394d716d-7d1c-4a60-90bf-04246a969803 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:55 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] Created reservations ['7a24ed3e-faa4-44b1-b801-5c374d6d6ab3', 'b5ce3d65-3aa1-4585-8a03-08ac5ac67557', 'c8c58edb-7fc5-4b68-b8ad-247cf8a8694b', 'd12d3435-fb29-45e6-aeb8-dc266d6a4bd5'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:55 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-394d716d-7d1c-4a60-90bf-04246a969803 Apr 16 13:30:55 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:55 devstack sudo[88884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:55 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:56 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.568s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:56 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:56 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] Deleted volume successfully. Apr 16 13:30:56 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5cdc9b30-2f26-4ecf-8813-f03e6777a61d tempest-ServerRescueNegativeTestJSON-1249032403 None] Lock "cinder-ae85d15c-f576-4062-8dac-242f8a011be0-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:56 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-394d716d-7d1c-4a60-90bf-04246a969803" returned: 0 in 0.980s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:56 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-quobyte-394d716d-7d1c-4a60-90bf-04246a969803" released by "delete_volume" :: held 1.718s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:56 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Created reservations ['a0b2d391-e88d-448c-8730-cc1e848ded6a', 'ff2a5c2c-76e7-4770-955c-436d553986b2', 'bfcaa706-c72e-4d7c-ad7e-8e88e3a3de74', 'c43b4ebc-d6d2-4729-8484-3577a48c24e9'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:56 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:56 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:56 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:56 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "cinder-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "cinder-quobyte-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-quobyte-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46" acquired by "delete_volume" :: waited 0.014s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:57 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39536f5-6874-4b34-91b0-9f8ba58bd4b9]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:57 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.621s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:57 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:57 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Deleted volume successfully. Apr 16 13:30:57 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46 Apr 16 13:30:57 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0cdecd56-bd91-44f8-9f84-16fdaa834ef9 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-394d716d-7d1c-4a60-90bf-04246a969803-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:57 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46" returned: 0 in 0.635s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:57 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46 Apr 16 13:30:57 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:58 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46" returned: 0 in 0.473s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:58 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-quobyte-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46" released by "delete_volume" :: held 1.162s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:58 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Created reservations ['cb24a3eb-5747-4791-8093-2c9bb32fdadc', 'd0c02bd2-ac92-4f4a-8a00-84aa98d9765e', '3b2740e2-359f-4aa8-b167-8f33aaca0c1d', 'fcbab898-2da7-4df9-9283-6accbda5766c'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:30:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:30:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:30:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:30:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:30:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:30:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:58 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:30:58 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:30:58 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 16 13:30:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.495s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:30:58 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:30:59 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Deleted volume successfully. Apr 16 13:30:59 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-28a2a5a4-95c1-4d6d-9c7a-3288b26313ca tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-ccc3fa2a-fa20-49aa-8d52-4cdd0cffdb46-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:30:59 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "cinder-5f954993-e335-4dd5-8fd1-55aa5520490c-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:59 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-5f954993-e335-4dd5-8fd1-55aa5520490c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:59 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "cinder-quobyte-5f954993-e335-4dd5-8fd1-55aa5520490c" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:30:59 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-quobyte-5f954993-e335-4dd5-8fd1-55aa5520490c" acquired by "delete_volume" :: waited 0.019s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:30:59 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[02484d58-87ad-437b-862e-96c8b1e3a9ce]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:30:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f954993-e335-4dd5-8fd1-55aa5520490c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:30:59 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f954993-e335-4dd5-8fd1-55aa5520490c Apr 16 13:30:59 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:00 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f954993-e335-4dd5-8fd1-55aa5520490c" returned: 0 in 0.605s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f954993-e335-4dd5-8fd1-55aa5520490c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:00 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f954993-e335-4dd5-8fd1-55aa5520490c Apr 16 13:31:00 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:00 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f954993-e335-4dd5-8fd1-55aa5520490c" returned: 0 in 0.460s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:00 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-quobyte-5f954993-e335-4dd5-8fd1-55aa5520490c" released by "delete_volume" :: held 1.088s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:31:00 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Created reservations ['da921202-af89-4e93-8f9f-90632bf82b6c', '196665ad-1224-4b00-8124-99bdc1535ca2', '079162fa-fc68-4e98-91c7-76320674780e', '2c1f1b04-fe09-4fe2-a812-27e6edb2cda6'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:31:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:31:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:31:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:00 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:31:00 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:01 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.437s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:01 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:31:01 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Deleted volume successfully. Apr 16 13:31:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-279d5981-b2d1-4a35-bc8b-39afcb5b1dc3 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-5f954993-e335-4dd5-8fd1-55aa5520490c-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:31:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "cinder-3f628fef-3865-4139-ad4b-0586359125e8-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:31:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-3f628fef-3865-4139-ad4b-0586359125e8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:31:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "cinder-quobyte-3f628fef-3865-4139-ad4b-0586359125e8" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:31:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-quobyte-3f628fef-3865-4139-ad4b-0586359125e8" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:31:01 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c88cf5f-0097-42b9-a2d0-e4b8c97bb919]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:31:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3f628fef-3865-4139-ad4b-0586359125e8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:01 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3f628fef-3865-4139-ad4b-0586359125e8 Apr 16 13:31:01 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:02 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3f628fef-3865-4139-ad4b-0586359125e8" returned: 0 in 0.632s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3f628fef-3865-4139-ad4b-0586359125e8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:02 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3f628fef-3865-4139-ad4b-0586359125e8 Apr 16 13:31:02 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:02 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3f628fef-3865-4139-ad4b-0586359125e8" returned: 0 in 0.571s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:02 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-quobyte-3f628fef-3865-4139-ad4b-0586359125e8" released by "delete_volume" :: held 1.242s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:31:02 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Created reservations ['b4aa8276-8c42-4664-9c39-4bfb08ee3cea', 'a012cd0c-f2df-4cc7-a38a-7b787b346bb1', '20ad38ab-d1c5-40f6-8652-86051beb6e6d', '824f2366-5596-41ee-ae77-d1b55180f95e'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:31:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:31:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:31:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:03 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:31:03 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:03 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.442s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:03 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:31:03 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Deleted volume successfully. Apr 16 13:31:03 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-6e81295c-3336-44dd-9714-069173861723 tempest-CreateVolumesFromSourceVolumeTest-612214678 None] Lock "cinder-3f628fef-3865-4139-ad4b-0586359125e8-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Flow 'volume_create_manager' (2e7d4898-41f5-4156-861a-b59533545d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660b3bdb-0bc5-4379-a841-28efe418bf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660b3bdb-0bc5-4379-a841-28efe418bf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1460845304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329f6cc0-ae81-4ccf-9331-562c968ae489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302c4fb8862040a2989d218491d31ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:31:07Z,use_quota=True,user_id='5bb4fc21724a430c9893deb9a589338c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a19d229-b19a-4f3a-ad11-d0cceb422976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a19d229-b19a-4f3a-ad11-d0cceb422976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3fe33d-40b4-4a66-9e1e-b47589c05acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3fe33d-40b4-4a66-9e1e-b47589c05acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '329f6cc0-ae81-4ccf-9331-562c968ae489', 'volume_name': 'volume-329f6cc0-ae81-4ccf-9331-562c968ae489', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a5d34f-9d98-4c6d-8e18-eb5532d63c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a5d34f-9d98-4c6d-8e18-eb5532d63c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a34d000-f6fc-4f20-9493-5d3b102f1b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:06 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Volume 329f6cc0-ae81-4ccf-9331-562c968ae489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-329f6cc0-ae81-4ccf-9331-562c968ae489', 'volume_size': 1} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1460845304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329f6cc0-ae81-4ccf-9331-562c968ae489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302c4fb8862040a2989d218491d31ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:31:07Z,use_quota=True,user_id='5bb4fc21724a430c9893deb9a589338c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Creating volume 329f6cc0-ae81-4ccf-9331-562c968ae489 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:31:06 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:31:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:06 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 1073741824 Apr 16 13:31:06 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:07 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 1073741824" returned: 0 in 0.496s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:07 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 Apr 16 13:31:07 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:07 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489" returned: 0 in 0.390s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:07 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:31:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a34d000-f6fc-4f20-9493-5d3b102f1b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-329f6cc0-ae81-4ccf-9331-562c968ae489', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb6a045-2ea3-4597-a738-f226e1a9be16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:07 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Volume volume-329f6cc0-ae81-4ccf-9331-562c968ae489 (329f6cc0-ae81-4ccf-9331-562c968ae489): created successfully Apr 16 13:31:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb6a045-2ea3-4597-a738-f226e1a9be16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Flow 'volume_create_manager' (2e7d4898-41f5-4156-861a-b59533545d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:31:07 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-f39389ac-7007-437d-95c6-474876eb6e28 tempest-VolumesActionsTest-681490842 None] Created volume successfully. Apr 16 13:31:13 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-15467979-0898-43e8-a63d-db7ada71a0a4 tempest-GroupsTest-733651565 None] Group tempest-Group1-1563080699: creating Apr 16 13:31:13 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-15467979-0898-43e8-a63d-db7ada71a0a4 tempest-GroupsTest-733651565 None] Group tempest-Group1-1563080699: created successfully Apr 16 13:31:13 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-15467979-0898-43e8-a63d-db7ada71a0a4 tempest-GroupsTest-733651565 None] Create group completed successfully. Apr 16 13:31:15 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-69dda6be-6c82-480f-9e44-92b87f5508a7 tempest-GroupsTest-733651565 None] Group tempest-Group2-1434100109: creating Apr 16 13:31:15 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-69dda6be-6c82-480f-9e44-92b87f5508a7 tempest-GroupsTest-733651565 None] Group tempest-Group2-1434100109: created successfully Apr 16 13:31:15 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-69dda6be-6c82-480f-9e44-92b87f5508a7 tempest-GroupsTest-733651565 None] Create group completed successfully. Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Flow 'volume_create_manager' (197a0d73-7397-4a0b-ab08-42313e8725ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f056c4a-9bf6-4023-9402-b1ed2220f9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f056c4a-9bf6-4023-9402-b1ed2220f9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951527852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=21069d54-990f-40a9-935e-677f209b8e5b,host='devstack@QuobyteHD#QuobyteHD',id=a93db265-2eac-4ad3-a28e-a96ea87850f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cfcc89206db4891b2c0180b20492b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:31:16Z,use_quota=True,user_id='310464646aea45f0b8df678524b705cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19b580da-67ea-4cb1-878a-9c3f5179d092),volume_type_id=19b580da-67ea-4cb1-878a-9c3f5179d092)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4022b24e-7a98-4ce6-b362-68bef06e6e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4022b24e-7a98-4ce6-b362-68bef06e6e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490303c4-e21f-4637-afbc-7db573d1bb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490303c4-e21f-4637-afbc-7db573d1bb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a93db265-2eac-4ad3-a28e-a96ea87850f7', 'volume_name': 'volume-a93db265-2eac-4ad3-a28e-a96ea87850f7', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4873c8c-a6b9-4093-b65d-a3683acb0ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4873c8c-a6b9-4093-b65d-a3683acb0ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60416304-214f-4078-8a1d-2b447a1b4893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:16 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Volume a93db265-2eac-4ad3-a28e-a96ea87850f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a93db265-2eac-4ad3-a28e-a96ea87850f7', 'volume_size': 1} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=21069d54-990f-40a9-935e-677f209b8e5b,created_at=2026-04-16T11:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951527852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=21069d54-990f-40a9-935e-677f209b8e5b,host='devstack@QuobyteHD#QuobyteHD',id=a93db265-2eac-4ad3-a28e-a96ea87850f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cfcc89206db4891b2c0180b20492b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:31:16Z,use_quota=True,user_id='310464646aea45f0b8df678524b705cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19b580da-67ea-4cb1-878a-9c3f5179d092),volume_type_id=19b580da-67ea-4cb1-878a-9c3f5179d092)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Creating volume a93db265-2eac-4ad3-a28e-a96ea87850f7 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:31:16 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a93db265-2eac-4ad3-a28e-a96ea87850f7 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:16 devstack sudo[89051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a93db265-2eac-4ad3-a28e-a96ea87850f7 1073741824 Apr 16 13:31:16 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:16 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a93db265-2eac-4ad3-a28e-a96ea87850f7 1073741824" returned: 0 in 0.491s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a93db265-2eac-4ad3-a28e-a96ea87850f7 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:16 devstack sudo[89056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a93db265-2eac-4ad3-a28e-a96ea87850f7 Apr 16 13:31:16 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:17 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a93db265-2eac-4ad3-a28e-a96ea87850f7" returned: 0 in 0.440s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:31:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:17 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60416304-214f-4078-8a1d-2b447a1b4893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a93db265-2eac-4ad3-a28e-a96ea87850f7', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:17 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acf218b-b77b-477e-948c-f8208a88cedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:17 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Volume volume-a93db265-2eac-4ad3-a28e-a96ea87850f7 (a93db265-2eac-4ad3-a28e-a96ea87850f7): created successfully Apr 16 13:31:17 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acf218b-b77b-477e-948c-f8208a88cedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:17 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Flow 'volume_create_manager' (197a0d73-7397-4a0b-ab08-42313e8725ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:31:17 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-c81428bb-d79f-4ec1-b07f-0d361b466143 tempest-GroupsTest-733651565 None] Created volume successfully. Apr 16 13:31:18 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:UPDATE=245,cinder:SELECT=158,cinder:INSERT=52,cinder:DELETE=14 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:31:18 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] Acquiring lock "cinder-quobyte-a93db265-2eac-4ad3-a28e-a96ea87850f7" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:31:18 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] Lock "cinder-quobyte-a93db265-2eac-4ad3-a28e-a96ea87850f7" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:31:18 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d26e653-8ace-4813-b247-1bd5289d6da3]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:31:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a93db265-2eac-4ad3-a28e-a96ea87850f7 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:19 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a93db265-2eac-4ad3-a28e-a96ea87850f7 Apr 16 13:31:19 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:19 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a93db265-2eac-4ad3-a28e-a96ea87850f7" returned: 0 in 0.530s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a93db265-2eac-4ad3-a28e-a96ea87850f7 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:19 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a93db265-2eac-4ad3-a28e-a96ea87850f7 Apr 16 13:31:19 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:20 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a93db265-2eac-4ad3-a28e-a96ea87850f7" returned: 0 in 0.587s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:20 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] Lock "cinder-quobyte-a93db265-2eac-4ad3-a28e-a96ea87850f7" released by "delete_volume" :: held 1.150s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:31:20 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:DELETE=24,cinder:SELECT=132,cinder:UPDATE=202,cinder:INSERT=49 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:31:20 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] Created reservations ['0ab11feb-f742-4e01-ac99-652d79e60e6a'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:31:20 devstack cinder-volume[83606]: WARNING cinder.quota [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-340920226 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-340920226, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:31:20 devstack cinder-volume[83606]: WARNING cinder.quota [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-340920226 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-340920226, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:31:20 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] Created reservations ['1f6e35a0-c664-4727-b6e0-501e683cc61e', '379a3daa-cf03-4086-9c61-30cef00508c5', '88cb2860-42d7-49f8-8c98-1d4497477875', '74cd2a8d-1f61-4bbc-8fa9-b9bd8cc9db45'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:31:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:31:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:31:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:20 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:31:20 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:20 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.564s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:20 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:31:20 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-9e325034-2278-445b-a43a-e4c157d80125 tempest-GroupsTest-733651565 None] Delete group completed successfully. Apr 16 13:31:21 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-72bc3c2c-3d93-4dd3-8266-51f33de778cf tempest-GroupsTest-733651565 None] Created reservations ['11a4498d-c56c-41b5-a4fb-d0b2b290b7e3'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:31:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-72bc3c2c-3d93-4dd3-8266-51f33de778cf tempest-GroupsTest-733651565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-72bc3c2c-3d93-4dd3-8266-51f33de778cf tempest-GroupsTest-733651565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:21 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-72bc3c2c-3d93-4dd3-8266-51f33de778cf tempest-GroupsTest-733651565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:31:21 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-72bc3c2c-3d93-4dd3-8266-51f33de778cf tempest-GroupsTest-733651565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:31:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-72bc3c2c-3d93-4dd3-8266-51f33de778cf tempest-GroupsTest-733651565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-72bc3c2c-3d93-4dd3-8266-51f33de778cf tempest-GroupsTest-733651565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:21 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:31:21 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:21 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-72bc3c2c-3d93-4dd3-8266-51f33de778cf tempest-GroupsTest-733651565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.471s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:21 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-72bc3c2c-3d93-4dd3-8266-51f33de778cf tempest-GroupsTest-733651565 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:31:21 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-72bc3c2c-3d93-4dd3-8266-51f33de778cf tempest-GroupsTest-733651565 None] Delete group completed successfully. Apr 16 13:31:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3b6e8aba-629c-4085-8dc1-236a0a1206eb tempest-VolumesActionsTest-681490842 None] Acquiring lock "cinder-329f6cc0-ae81-4ccf-9331-562c968ae489" by "attach_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:31:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3b6e8aba-629c-4085-8dc1-236a0a1206eb tempest-VolumesActionsTest-681490842 None] Lock "cinder-329f6cc0-ae81-4ccf-9331-562c968ae489" acquired by "attach_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:31:22 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-3b6e8aba-629c-4085-8dc1-236a0a1206eb tempest-VolumesActionsTest-681490842 None] Attaching volume 329f6cc0-ae81-4ccf-9331-562c968ae489 to instance 106db5fc-b3ad-4782-993d-45fe7badb340 at mountpoint /dev/vdb on host None. Apr 16 13:31:22 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-3b6e8aba-629c-4085-8dc1-236a0a1206eb tempest-VolumesActionsTest-681490842 None] Attach volume completed successfully. Apr 16 13:31:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3b6e8aba-629c-4085-8dc1-236a0a1206eb tempest-VolumesActionsTest-681490842 None] Lock "cinder-329f6cc0-ae81-4ccf-9331-562c968ae489" released by "attach_volume" :: held 0.084s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:31:22 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-cb7ed5f1-31e6-453f-9d20-c00722504160 tempest-GroupsTest-733651565 None] Group tempest-GroupsTest-Group-1011102275: creating Apr 16 13:31:22 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-cb7ed5f1-31e6-453f-9d20-c00722504160 tempest-GroupsTest-733651565 None] Group tempest-GroupsTest-Group-1011102275: created successfully Apr 16 13:31:22 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-cb7ed5f1-31e6-453f-9d20-c00722504160 tempest-GroupsTest-733651565 None] Create group completed successfully. Apr 16 13:31:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-100f6016-b1a9-40f2-85ea-2cc3605a609f tempest-VolumesActionsTest-681490842 None] Acquiring lock "cinder-329f6cc0-ae81-4ccf-9331-562c968ae489-detach_volume" by "detach_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:31:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-100f6016-b1a9-40f2-85ea-2cc3605a609f tempest-VolumesActionsTest-681490842 None] Lock "cinder-329f6cc0-ae81-4ccf-9331-562c968ae489-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:31:23 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-100f6016-b1a9-40f2-85ea-2cc3605a609f tempest-VolumesActionsTest-681490842 None] Detaching volume 329f6cc0-ae81-4ccf-9331-562c968ae489 from instance 106db5fc-b3ad-4782-993d-45fe7badb340. Apr 16 13:31:23 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-100f6016-b1a9-40f2-85ea-2cc3605a609f tempest-VolumesActionsTest-681490842 None] Detach volume completed successfully. Apr 16 13:31:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-100f6016-b1a9-40f2-85ea-2cc3605a609f tempest-VolumesActionsTest-681490842 None] Lock "cinder-329f6cc0-ae81-4ccf-9331-562c968ae489-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Flow 'volume_create_manager' (59120fdc-5188-48d6-a679-e5f3066e907a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29339d45-836a-4eec-8335-878fb10b4488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29339d45-836a-4eec-8335-878fb10b4488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1084478671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e439d29e-690a-47ff-b641-13fa5c12aa91,host='devstack@QuobyteHD#QuobyteHD',id=c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cfcc89206db4891b2c0180b20492b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:31:24Z,use_quota=True,user_id='310464646aea45f0b8df678524b705cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbd0e78e-21ae-441b-9d6b-ad862a175c48),volume_type_id=bbd0e78e-21ae-441b-9d6b-ad862a175c48)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6131c0b6-cc55-42ef-9cf0-26687ee84267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6131c0b6-cc55-42ef-9cf0-26687ee84267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff31ddd3-bbf2-41f1-8e55-3fb0ee36efed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff31ddd3-bbf2-41f1-8e55-3fb0ee36efed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0', 'volume_name': 'volume-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8471d2-3fe2-48b6-9d24-f073ebce2549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8471d2-3fe2-48b6-9d24-f073ebce2549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999b7d29-3e24-4569-be72-fef5711eaded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:24 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Volume c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0', 'volume_size': 1} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e439d29e-690a-47ff-b641-13fa5c12aa91,created_at=2026-04-16T11:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1084478671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e439d29e-690a-47ff-b641-13fa5c12aa91,host='devstack@QuobyteHD#QuobyteHD',id=c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cfcc89206db4891b2c0180b20492b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:31:24Z,use_quota=True,user_id='310464646aea45f0b8df678524b705cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbd0e78e-21ae-441b-9d6b-ad862a175c48),volume_type_id=bbd0e78e-21ae-441b-9d6b-ad862a175c48)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Creating volume c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:31:24 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:24 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0 1073741824 Apr 16 13:31:24 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:24 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0 1073741824" returned: 0 in 0.493s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:24 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0 Apr 16 13:31:24 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:25 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0" returned: 0 in 0.524s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:25 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:31:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:25 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999b7d29-3e24-4569-be72-fef5711eaded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:25 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d94af03a-16ff-4231-bc0e-cc0e9970d45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:25 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Volume volume-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0 (c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0): created successfully Apr 16 13:31:25 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d94af03a-16ff-4231-bc0e-cc0e9970d45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:25 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Flow 'volume_create_manager' (59120fdc-5188-48d6-a679-e5f3066e907a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:31:25 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-edf15d74-ce36-44d5-976c-e5522d141b2b tempest-GroupsTest-733651565 None] Created volume successfully. Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Flow 'volume_create_manager' (dbe5b827-f7c9-4849-9553-d2203cf9fefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71e32f5-f390-4288-b6de-f3cdbf2c64f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71e32f5-f390-4288-b6de-f3cdbf2c64f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-297439545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e439d29e-690a-47ff-b641-13fa5c12aa91,host='devstack@QuobyteHD#QuobyteHD',id=a22dcbdc-1294-4174-9ef9-9bd72e23fd9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cfcc89206db4891b2c0180b20492b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:31:27Z,use_quota=True,user_id='310464646aea45f0b8df678524b705cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbd0e78e-21ae-441b-9d6b-ad862a175c48),volume_type_id=bbd0e78e-21ae-441b-9d6b-ad862a175c48)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4907f910-8207-4866-a8fb-f7592dc8e0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4907f910-8207-4866-a8fb-f7592dc8e0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1412ae98-2cd4-4a72-8b77-c7ac9d30f69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1412ae98-2cd4-4a72-8b77-c7ac9d30f69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a22dcbdc-1294-4174-9ef9-9bd72e23fd9a', 'volume_name': 'volume-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdde13a9-e8ee-4946-ad26-e8679b7ec685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdde13a9-e8ee-4946-ad26-e8679b7ec685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801a02e3-4aeb-445e-ab26-1062db433e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:26 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Volume a22dcbdc-1294-4174-9ef9-9bd72e23fd9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a', 'volume_size': 1} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e439d29e-690a-47ff-b641-13fa5c12aa91,created_at=2026-04-16T11:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-297439545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e439d29e-690a-47ff-b641-13fa5c12aa91,host='devstack@QuobyteHD#QuobyteHD',id=a22dcbdc-1294-4174-9ef9-9bd72e23fd9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cfcc89206db4891b2c0180b20492b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:31:27Z,use_quota=True,user_id='310464646aea45f0b8df678524b705cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbd0e78e-21ae-441b-9d6b-ad862a175c48),volume_type_id=bbd0e78e-21ae-441b-9d6b-ad862a175c48)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Creating volume a22dcbdc-1294-4174-9ef9-9bd72e23fd9a {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:31:26 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:31:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:26 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a 1073741824 Apr 16 13:31:26 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:27 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a 1073741824" returned: 0 in 0.488s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:27 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a Apr 16 13:31:27 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:27 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a" returned: 0 in 0.428s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:31:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801a02e3-4aeb-445e-ab26-1062db433e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc01c9e-6940-48d8-986b-32aaef984c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:27 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Volume volume-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a (a22dcbdc-1294-4174-9ef9-9bd72e23fd9a): created successfully Apr 16 13:31:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc01c9e-6940-48d8-986b-32aaef984c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Flow 'volume_create_manager' (dbe5b827-f7c9-4849-9553-d2203cf9fefd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:31:27 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-92809042-9f0d-4f8d-ad53-8f964e233966 tempest-GroupsTest-733651565 None] Created volume successfully. Apr 16 13:31:28 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-8fa063ca-518e-4277-bc69-60a56bd3de46 tempest-GroupsTest-733651565 None] Update group completed successfully. Apr 16 13:31:30 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-b636ac2d-f76b-4b6b-9f4c-3329fabbaf81 tempest-GroupsTest-733651565 None] Update group completed successfully. Apr 16 13:31:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Acquiring lock "cinder-quobyte-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:31:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Lock "cinder-quobyte-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:31:31 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[472b6c64-69c5-46f8-99aa-8f263f8d5c21]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:31:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:31 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a Apr 16 13:31:31 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:31 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a" returned: 0 in 0.515s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:31 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a Apr 16 13:31:31 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:32 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a" returned: 0 in 0.395s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Lock "cinder-quobyte-a22dcbdc-1294-4174-9ef9-9bd72e23fd9a" released by "delete_volume" :: held 0.933s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:31:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Acquiring lock "cinder-quobyte-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:31:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Lock "cinder-quobyte-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0" acquired by "delete_volume" :: waited 0.005s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:31:32 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[893c93ed-5ba8-42e2-a61a-5257313b5056]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:31:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:32 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0 Apr 16 13:31:32 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:32 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0" returned: 0 in 0.492s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:32 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0 Apr 16 13:31:32 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:33 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0" returned: 0 in 0.404s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:33 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Lock "cinder-quobyte-c7c6dcfb-afc3-4b73-b602-3fa00e5aa2a0" released by "delete_volume" :: held 0.917s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:31:33 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Created reservations ['d1d33687-ce2b-43fc-95a4-83ce2f641054'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:31:33 devstack cinder-volume[83606]: WARNING cinder.quota [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-941304704 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-941304704, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:31:33 devstack cinder-volume[83606]: WARNING cinder.quota [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-941304704 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-941304704, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:31:33 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Created reservations ['1bb175cb-b002-4638-a5fe-213bfcbc2dc5', '075d952c-b5a8-46dd-828b-a4a7a9314275', 'b2228205-aafb-4940-8839-43e360fdc84e', '7bb9b846-497a-4e8f-ab04-f3b644f36d34'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:31:33 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Created reservations ['6c4181b6-3e66-431b-a871-3850ad9a9ee8', '17c6dd17-079b-4a79-98e9-f8b25f4a9141', '49aaf2b6-f672-4a81-905d-e899e3191e69', '6cd60e54-5401-4e00-9eed-c269145e9d30'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:31:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:33 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:31:33 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:31:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:33 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:31:33 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:33 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.506s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:33 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:31:33 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-f316c19e-fa85-4a50-be80-9f8d06bb9b96 tempest-GroupsTest-733651565 None] Delete group completed successfully. Apr 16 13:31:34 devstack cinder-volume[83606]: DEBUG oslo_service.periodic_task [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83606) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 13:31:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:31:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:31:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:34 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:31:34 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:35 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.505s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:35 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:31:36 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d449fcc1-5389-4839-aba8-9e4c999d6fcd tempest-GroupsV314Test-1051457857 None] Group tempest-GroupsV314Test-Group-761844492: creating Apr 16 13:31:36 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d449fcc1-5389-4839-aba8-9e4c999d6fcd tempest-GroupsV314Test-1051457857 None] Group tempest-GroupsV314Test-Group-761844492: created successfully Apr 16 13:31:36 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d449fcc1-5389-4839-aba8-9e4c999d6fcd tempest-GroupsV314Test-1051457857 None] Create group completed successfully. Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Flow 'volume_create_manager' (7cbdae50-d3c1-4b8c-8743-04ce55111a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83b2043-0b7e-4b96-9554-5d241a6f4288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83b2043-0b7e-4b96-9554-5d241a6f4288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1714603780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4439bc4-65cf-499f-a8b1-5a212dcfa8e2,host='devstack@QuobyteHD#QuobyteHD',id=3482df2b-af48-472b-a991-140f85bf5478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98bf5be69632491496ee3b2ff448a8b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:31:38Z,use_quota=True,user_id='3686aa5758d649f29c93a87d5bc6c8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c122d918-d01a-4e36-9e0d-51e7527f1cb1),volume_type_id=c122d918-d01a-4e36-9e0d-51e7527f1cb1)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38eda98-0fa3-49f5-9263-a3bca2ec4192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38eda98-0fa3-49f5-9263-a3bca2ec4192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de6270e-bd1d-40f8-9db8-d9f8b1ebf6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de6270e-bd1d-40f8-9db8-d9f8b1ebf6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3482df2b-af48-472b-a991-140f85bf5478', 'volume_name': 'volume-3482df2b-af48-472b-a991-140f85bf5478', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8661590-357f-4893-9df3-dbbd5eb16453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8661590-357f-4893-9df3-dbbd5eb16453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3564083d-d8b4-47c4-bedb-c172adc836c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:37 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Volume 3482df2b-af48-472b-a991-140f85bf5478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3482df2b-af48-472b-a991-140f85bf5478', 'volume_size': 1} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d4439bc4-65cf-499f-a8b1-5a212dcfa8e2,created_at=2026-04-16T11:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1714603780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4439bc4-65cf-499f-a8b1-5a212dcfa8e2,host='devstack@QuobyteHD#QuobyteHD',id=3482df2b-af48-472b-a991-140f85bf5478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98bf5be69632491496ee3b2ff448a8b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:31:38Z,use_quota=True,user_id='3686aa5758d649f29c93a87d5bc6c8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c122d918-d01a-4e36-9e0d-51e7527f1cb1),volume_type_id=c122d918-d01a-4e36-9e0d-51e7527f1cb1)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Creating volume 3482df2b-af48-472b-a991-140f85bf5478 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:31:37 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:31:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:37 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 1073741824 Apr 16 13:31:37 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:38 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 1073741824" returned: 0 in 0.511s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:38 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 Apr 16 13:31:38 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:38 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478" returned: 0 in 0.404s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:38 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:31:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3564083d-d8b4-47c4-bedb-c172adc836c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3482df2b-af48-472b-a991-140f85bf5478', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0122e459-645f-4f05-8ac0-69942c08bb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:31:38 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Volume volume-3482df2b-af48-472b-a991-140f85bf5478 (3482df2b-af48-472b-a991-140f85bf5478): created successfully Apr 16 13:31:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0122e459-645f-4f05-8ac0-69942c08bb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:31:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Flow 'volume_create_manager' (7cbdae50-d3c1-4b8c-8743-04ce55111a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:31:38 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-0f00e833-8a6e-4610-9e31-3f07762a9dd5 tempest-GroupsV314Test-1051457857 None] Created volume successfully. Apr 16 13:31:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:39 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Cloning volume 3482df2b-af48-472b-a991-140f85bf5478 to volume 78baddcb-d054-4c05-8385-3b0fd5cfb658 Apr 16 13:31:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Creating offline snapshot 8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 of volume 3482df2b-af48-472b-a991-140f85bf5478 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:31:39 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3d06d6-3647-4598-a2c3-df300d7a09e1]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:31:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:39 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 Apr 16 13:31:39 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:40 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478" returned: 0 in 0.467s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:40 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 1G Apr 16 13:31:40 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:40 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 1G" returned: 0 in 0.490s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3482df2b-af48-472b-a991-140f85bf5478 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:40 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3482df2b-af48-472b-a991-140f85bf5478 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 Apr 16 13:31:40 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:41 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3482df2b-af48-472b-a991-140f85bf5478 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707" returned: 0 in 0.439s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:41 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 13:31:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:41 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 Apr 16 13:31:41 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:41 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707" returned: 0 in 0.411s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:41 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.info Apr 16 13:31:41 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:41 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.info" returned: 0 in 0.422s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:41 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 13:31:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:41 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.info Apr 16 13:31:41 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:42 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.info" returned: 0 in 0.448s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:42 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Acquiring lock "cinder-quobyte-78baddcb-d054-4c05-8385-3b0fd5cfb658" by "_copy_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:31:42 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Lock "cinder-quobyte-78baddcb-d054-4c05-8385-3b0fd5cfb658" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:31:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] snapshot: 8c9ba8ba-bc6a-4e26-ab10-3b910ab94707, volume: 78baddcb-d054-4c05-8385-3b0fd5cfb658, {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 13:31:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:31:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:31:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:42 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e434fb9-7f2a-4366-ac3c-a6ba7d3bc8f2]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:31:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:42 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 Apr 16 13:31:42 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:43 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707" returned: 0 in 0.600s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3482df2b-af48-472b-a991-140f85bf5478(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:31:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 13:31:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Creating direct copy from snapshot {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 13:31:43 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e27e27-1973-4466-8833-3df697d67f0b]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:31:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:43 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 Apr 16 13:31:43 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:43 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478" returned: 0 in 0.473s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:43 devstack cinder-volume[83606]: DEBUG cinder.utils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Path /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-78baddcb-d054-4c05-8385-3b0fd5cfb658 not found in is_blk_device check {{(pid=83606) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 13:31:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-78baddcb-d054-4c05-8385-3b0fd5cfb658 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:43 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-78baddcb-d054-4c05-8385-3b0fd5cfb658 Apr 16 13:31:43 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:44 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e86d5a06-e341-4c46-a1b7-acd9d0a5e5e3 tempest-VolumesActionsTest-681490842 None] Acquiring lock "cinder-329f6cc0-ae81-4ccf-9331-562c968ae489" by "attach_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:31:44 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e86d5a06-e341-4c46-a1b7-acd9d0a5e5e3 tempest-VolumesActionsTest-681490842 None] Lock "cinder-329f6cc0-ae81-4ccf-9331-562c968ae489" acquired by "attach_volume" :: waited 0.042s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:31:44 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-e86d5a06-e341-4c46-a1b7-acd9d0a5e5e3 tempest-VolumesActionsTest-681490842 None] Attaching volume 329f6cc0-ae81-4ccf-9331-562c968ae489 to instance 3ba74421-b9fe-4a0e-ad7f-449adf82ddd3 at mountpoint /dev/vdb on host None. Apr 16 13:31:44 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-e86d5a06-e341-4c46-a1b7-acd9d0a5e5e3 tempest-VolumesActionsTest-681490842 None] Attach volume completed successfully. Apr 16 13:31:44 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e86d5a06-e341-4c46-a1b7-acd9d0a5e5e3 tempest-VolumesActionsTest-681490842 None] Lock "cinder-329f6cc0-ae81-4ccf-9331-562c968ae489" released by "attach_volume" :: held 0.232s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:31:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a20b3df7-a41a-4398-98b1-29fa957d7f4f tempest-VolumesActionsTest-681490842 None] Acquiring lock "cinder-329f6cc0-ae81-4ccf-9331-562c968ae489-detach_volume" by "detach_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:31:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a20b3df7-a41a-4398-98b1-29fa957d7f4f tempest-VolumesActionsTest-681490842 None] Lock "cinder-329f6cc0-ae81-4ccf-9331-562c968ae489-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:31:45 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-a20b3df7-a41a-4398-98b1-29fa957d7f4f tempest-VolumesActionsTest-681490842 None] Detaching volume 329f6cc0-ae81-4ccf-9331-562c968ae489 from instance 3ba74421-b9fe-4a0e-ad7f-449adf82ddd3. Apr 16 13:31:45 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-a20b3df7-a41a-4398-98b1-29fa957d7f4f tempest-VolumesActionsTest-681490842 None] Detach volume completed successfully. Apr 16 13:31:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a20b3df7-a41a-4398-98b1-29fa957d7f4f tempest-VolumesActionsTest-681490842 None] Lock "cinder-329f6cc0-ae81-4ccf-9331-562c968ae489-detach_volume" released by "detach_volume" :: held 0.225s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:31:46 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-78baddcb-d054-4c05-8385-3b0fd5cfb658" returned: 0 in 2.462s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:46 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[26852042-ba0c-4dcc-8183-b1c6719985fa]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:31:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:46 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 Apr 16 13:31:46 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:46 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478" returned: 0 in 0.628s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:46 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Image conversion details: src /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478, size 1024.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-78baddcb-d054-4c05-8385-3b0fd5cfb658 {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:31:46 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Converted 1024.00 MB image at 415.72 MB/s Apr 16 13:31:46 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-78baddcb-d054-4c05-8385-3b0fd5cfb658 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 13:31:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-78baddcb-d054-4c05-8385-3b0fd5cfb658 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:46 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-78baddcb-d054-4c05-8385-3b0fd5cfb658 Apr 16 13:31:46 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:47 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-78baddcb-d054-4c05-8385-3b0fd5cfb658" returned: 0 in 0.405s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:47 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Lock "cinder-quobyte-78baddcb-d054-4c05-8385-3b0fd5cfb658" released by "_copy_volume_from_snapshot" :: held 4.638s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:31:47 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Acquiring lock "cinder-quobyte-8c9ba8ba-bc6a-4e26-ab10-3b910ab94707" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:31:47 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Lock "cinder-quobyte-8c9ba8ba-bc6a-4e26-ab10-3b910ab94707" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:31:47 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Deleting offline snapshot 8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 of volume 3482df2b-af48-472b-a991-140f85bf5478 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:31:47 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] snapshot_file for this snap is: volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:31:47 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fd7c2a-3dad-44ab-8b33-70835e349689]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:31:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:47 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 Apr 16 13:31:47 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:47 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707" returned: 0 in 0.543s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:47 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3482df2b-af48-472b-a991-140f85bf5478(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:31:47 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e97f3b9-928f-44c2-8115-831e29bedaaa]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:31:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:47 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 Apr 16 13:31:47 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:48 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478" returned: 0 in 0.463s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:48 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 Apr 16 13:31:48 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:48 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707" returned: 0 in 0.474s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:48 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707 Apr 16 13:31:48 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:49 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478.8c9ba8ba-bc6a-4e26-ab10-3b910ab94707" returned: 0 in 0.444s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Lock "cinder-quobyte-8c9ba8ba-bc6a-4e26-ab10-3b910ab94707" released by "_delete_snapshot" :: held 1.969s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:31:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.423s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:49 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-5d89d209-4c5b-418c-8e47-97642df6beeb tempest-GroupsV314Test-1051457857 None] Create group from source-group-d4439bc4-65cf-499f-a8b1-5a212dcfa8e2 completed successfully. Apr 16 13:31:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] Acquiring lock "cinder-quobyte-78baddcb-d054-4c05-8385-3b0fd5cfb658" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:31:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] Lock "cinder-quobyte-78baddcb-d054-4c05-8385-3b0fd5cfb658" acquired by "delete_volume" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:31:49 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8c594d-e832-4a86-af25-b0d869ed4a3b]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:31:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-78baddcb-d054-4c05-8385-3b0fd5cfb658 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:49 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-78baddcb-d054-4c05-8385-3b0fd5cfb658 Apr 16 13:31:49 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:50 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-78baddcb-d054-4c05-8385-3b0fd5cfb658" returned: 0 in 0.461s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-78baddcb-d054-4c05-8385-3b0fd5cfb658 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:50 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-78baddcb-d054-4c05-8385-3b0fd5cfb658 Apr 16 13:31:50 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:50 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-78baddcb-d054-4c05-8385-3b0fd5cfb658" returned: 0 in 0.391s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] Lock "cinder-quobyte-78baddcb-d054-4c05-8385-3b0fd5cfb658" released by "delete_volume" :: held 0.874s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:31:50 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] Created reservations ['57a1cd62-7bca-4067-981c-14ce98aa2cf7'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:31:50 devstack cinder-volume[83606]: WARNING cinder.quota [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1227139566 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1227139566, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:31:50 devstack cinder-volume[83606]: WARNING cinder.quota [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1227139566 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1227139566, it is now deprecated. Please use the default quota class for default quota. Apr 16 13:31:50 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] Created reservations ['aa714ebb-5a7f-42f2-84b7-942d76e621f8', '5208391a-231b-4bb5-81d7-5567a365b065', '53a2865b-ab89-40e7-af79-106b657a9625', 'fe2edc22-67d4-4898-807a-4c15eda38b61'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:31:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:50 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:31:50 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:31:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:50 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:31:50 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] Acquiring lock "cinder-quobyte-3482df2b-af48-472b-a991-140f85bf5478" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:31:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] Lock "cinder-quobyte-3482df2b-af48-472b-a991-140f85bf5478" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:31:51 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bef9888-8941-48c7-9057-c3177179c869]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:31:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:51 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 Apr 16 13:31:51 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:51 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.426s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:51 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:31:51 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-a58fd47a-2a53-443e-a78e-4c3e7ca61494 tempest-GroupsV314Test-1051457857 None] Delete group completed successfully. Apr 16 13:31:51 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478" returned: 0 in 0.448s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:51 devstack sudo[89350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478 Apr 16 13:31:51 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:51 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3482df2b-af48-472b-a991-140f85bf5478" returned: 0 in 0.412s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] Lock "cinder-quobyte-3482df2b-af48-472b-a991-140f85bf5478" released by "delete_volume" :: held 0.905s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:31:52 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] Created reservations ['d7293ef7-26b3-4f1a-bbca-ba09ff8eafae'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:31:52 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] Created reservations ['1de758aa-9182-4c96-aad1-7940e41bd2ea', '35f62b62-6be0-408d-95c8-3d01342288e5', 'abde58fa-b4c2-40b2-be63-22a999a1d77e', 'ec8a1646-baa3-4aa5-98e4-7f3c19f7f239'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:31:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:31:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:31:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:31:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:52 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:31:52 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:52 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.434s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:52 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:31:52 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-06910b69-3f95-480e-a0c4-d6e153cca822 tempest-GroupsV314Test-1051457857 None] Delete group completed successfully. Apr 16 13:31:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4bfec6e3-edd9-4d1c-93f3-1f669d2683f8 tempest-VolumesActionsTest-681490842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:31:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4bfec6e3-edd9-4d1c-93f3-1f669d2683f8 tempest-VolumesActionsTest-681490842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:31:54 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d28ad0f-a38d-44ce-94ad-38f20d4e9dd4]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:31:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4bfec6e3-edd9-4d1c-93f3-1f669d2683f8 tempest-VolumesActionsTest-681490842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:54 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 Apr 16 13:31:54 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:54 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4bfec6e3-edd9-4d1c-93f3-1f669d2683f8 tempest-VolumesActionsTest-681490842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489" returned: 0 in 0.514s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:54 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[694cc7fa-307a-4b2f-ae62-bd7fec28f3ee]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:31:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4bfec6e3-edd9-4d1c-93f3-1f669d2683f8 tempest-VolumesActionsTest-681490842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:54 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 Apr 16 13:31:54 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:55 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4bfec6e3-edd9-4d1c-93f3-1f669d2683f8 tempest-VolumesActionsTest-681490842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489" returned: 0 in 0.483s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4bfec6e3-edd9-4d1c-93f3-1f669d2683f8 tempest-VolumesActionsTest-681490842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.91fe7306-88ec-489a-83ff-dc010bb06cbadtubcn92.img {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:55 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.91fe7306-88ec-489a-83ff-dc010bb06cbadtubcn92.img Apr 16 13:31:55 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:57 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4bfec6e3-edd9-4d1c-93f3-1f669d2683f8 tempest-VolumesActionsTest-681490842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.91fe7306-88ec-489a-83ff-dc010bb06cbadtubcn92.img" returned: 0 in 2.010s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:57 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[96efd0da-db56-40e1-aee7-eb1d2b9a4252]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:31:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4bfec6e3-edd9-4d1c-93f3-1f669d2683f8 tempest-VolumesActionsTest-681490842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:31:57 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 Apr 16 13:31:57 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:31:57 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Apr 16 13:31:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4bfec6e3-edd9-4d1c-93f3-1f669d2683f8 tempest-VolumesActionsTest-681490842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489" returned: 0 in 0.648s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:31:57 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-4bfec6e3-edd9-4d1c-93f3-1f669d2683f8 tempest-VolumesActionsTest-681490842 None] Image conversion details: src /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489, size 1024.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.91fe7306-88ec-489a-83ff-dc010bb06cbadtubcn92.img {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:31:57 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-4bfec6e3-edd9-4d1c-93f3-1f669d2683f8 tempest-VolumesActionsTest-681490842 None] Converted 1024.00 MB image at 508.95 MB/s Apr 16 13:31:57 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-4bfec6e3-edd9-4d1c-93f3-1f669d2683f8 tempest-VolumesActionsTest-681490842 None] 91fe7306-88ec-489a-83ff-dc010bb06cba was raw, no need to convert to raw {{(pid=83606) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 16 13:32:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4bfec6e3-edd9-4d1c-93f3-1f669d2683f8 tempest-VolumesActionsTest-681490842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.538s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-4bfec6e3-edd9-4d1c-93f3-1f669d2683f8 tempest-VolumesActionsTest-681490842 None] Uploaded volume to glance image-id: 91fe7306-88ec-489a-83ff-dc010bb06cba. {{(pid=83606) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 16 13:32:07 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-4bfec6e3-edd9-4d1c-93f3-1f669d2683f8 tempest-VolumesActionsTest-681490842 None] Copy volume to image completed successfully. Apr 16 13:32:07 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:SELECT=77,cinder:UPDATE=63,cinder:INSERT=18,cinder:DELETE=2 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:32:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:09 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[406c18a0-c2a3-4b8d-a020-fa282194f4f8]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:09 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 Apr 16 13:32:09 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:09 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489" returned: 0 in 0.505s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:09 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4572386-708a-4910-bca3-3e1736492ec6]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:09 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 Apr 16 13:32:09 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:10 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489" returned: 0 in 0.550s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.a74112b7-0409-44c3-87c6-47ea793c6fbaasok4dxl.img {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:10 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.a74112b7-0409-44c3-87c6-47ea793c6fbaasok4dxl.img Apr 16 13:32:10 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:10 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:32:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Flow 'volume_create_manager' (a3043830-d06e-45f6-85aa-10a789563b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c825a93-029a-487e-9e0b-ce5e56ed2311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c825a93-029a-487e-9e0b-ce5e56ed2311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-137022101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200507ce-5327-4a2b-966d-508a10a1f525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf90170908b541b2baf9a76232706df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:10Z,use_quota=True,user_id='87d441be01f546138499651d4ddafa26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbce027c-df37-482c-9e90-7341aad4faba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbce027c-df37-482c-9e90-7341aad4faba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (071a7afb-9a0f-476d-9154-c67bd152852d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (071a7afb-9a0f-476d-9154-c67bd152852d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '200507ce-5327-4a2b-966d-508a10a1f525', 'volume_name': 'volume-200507ce-5327-4a2b-966d-508a10a1f525', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37ef33e-faf4-4851-9f5e-041168888bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37ef33e-faf4-4851-9f5e-041168888bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd9d00c-0def-498d-be5a-95b1d98d8fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:10 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Volume 200507ce-5327-4a2b-966d-508a10a1f525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-200507ce-5327-4a2b-966d-508a10a1f525', 'volume_size': 1} Apr 16 13:32:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:12 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.a74112b7-0409-44c3-87c6-47ea793c6fbaasok4dxl.img" returned: 0 in 1.939s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:12 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b4161e-902a-4547-91d3-30efcb885427]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:12 devstack sudo[89451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 Apr 16 13:32:12 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:12 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489" returned: 0 in 0.609s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:12 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] Image conversion details: src /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489, size 1024.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.a74112b7-0409-44c3-87c6-47ea793c6fbaasok4dxl.img {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:32:12 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] Converted 1024.00 MB image at 527.81 MB/s Apr 16 13:32:12 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] a74112b7-0409-44c3-87c6-47ea793c6fba was raw, converting to qcow2 {{(pid=83606) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 16 13:32:12 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff6ae32-7fa4-4429-9093-2e4f68bb7887]: (4, 'raw') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.a74112b7-0409-44c3-87c6-47ea793c6fbaasok4dxl.img {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:12 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.a74112b7-0409-44c3-87c6-47ea793c6fbaasok4dxl.img Apr 16 13:32:12 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:13 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.a74112b7-0409-44c3-87c6-47ea793c6fbaasok4dxl.img" returned: 0 in 0.461s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.a74112b7-0409-44c3-87c6-47ea793c6fbaasok4dxl.img {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:13 devstack sudo[89460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.a74112b7-0409-44c3-87c6-47ea793c6fbaasok4dxl.img Apr 16 13:32:13 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:13 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.a74112b7-0409-44c3-87c6-47ea793c6fbaasok4dxl.img" returned: 1 in 0.439s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.a74112b7-0409-44c3-87c6-47ea793c6fbaasok4dxl.img' failed. Not Retrying. {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 13:32:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.a74112b7-0409-44c3-87c6-47ea793c6fbaasok4dxl.img /opt/stack/data/cinder/conversion/vol_upload_6eiijog_ {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:13 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.a74112b7-0409-44c3-87c6-47ea793c6fbaasok4dxl.img /opt/stack/data/cinder/conversion/vol_upload_6eiijog_ Apr 16 13:32:13 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:14 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.a74112b7-0409-44c3-87c6-47ea793c6fbaasok4dxl.img /opt/stack/data/cinder/conversion/vol_upload_6eiijog_" returned: 0 in 0.415s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:14 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] Image conversion details: src /opt/stack/data/cinder/conversion/329f6cc0-ae81-4ccf-9331-562c968ae489.temp_image.a74112b7-0409-44c3-87c6-47ea793c6fbaasok4dxl.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_6eiijog_ {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:32:14 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 16 13:32:14 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d46c56-7c3c-4c6d-bbf1-a751cd26a638]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6eiijog_ {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:14 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6eiijog_ Apr 16 13:32:14 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:14 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6eiijog_" returned: 0 in 0.448s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.271s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:15 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] Uploaded volume to glance image-id: a74112b7-0409-44c3-87c6-47ea793c6fba. {{(pid=83606) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 16 13:32:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.033s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-137022101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200507ce-5327-4a2b-966d-508a10a1f525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf90170908b541b2baf9a76232706df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:10Z,use_quota=True,user_id='87d441be01f546138499651d4ddafa26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:32:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Creating volume 200507ce-5327-4a2b-966d-508a10a1f525 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:32:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:32:15 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:32:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-200507ce-5327-4a2b-966d-508a10a1f525 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:15 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-200507ce-5327-4a2b-966d-508a10a1f525 1073741824 Apr 16 13:32:15 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:15 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-3c3d60c7-45a6-402b-b3a4-2c5b31cede0d tempest-VolumesActionsTest-681490842 None] Copy volume to image completed successfully. Apr 16 13:32:15 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-200507ce-5327-4a2b-966d-508a10a1f525 1073741824" returned: 0 in 0.496s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-200507ce-5327-4a2b-966d-508a10a1f525 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:16 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-200507ce-5327-4a2b-966d-508a10a1f525 Apr 16 13:32:16 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:16 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-200507ce-5327-4a2b-966d-508a10a1f525" returned: 0 in 0.402s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd9d00c-0def-498d-be5a-95b1d98d8fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-200507ce-5327-4a2b-966d-508a10a1f525', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98dae989-55c5-444d-80b9-29c3c68530e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:16 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Volume volume-200507ce-5327-4a2b-966d-508a10a1f525 (200507ce-5327-4a2b-966d-508a10a1f525): created successfully Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98dae989-55c5-444d-80b9-29c3c68530e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Flow 'volume_create_manager' (a3043830-d06e-45f6-85aa-10a789563b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:16 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-5f8668d6-fd2b-4353-99bf-ff45990062a4 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Created volume successfully. Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] Acquiring lock "cinder-200507ce-5327-4a2b-966d-508a10a1f525-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] Lock "cinder-200507ce-5327-4a2b-966d-508a10a1f525-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] Acquiring lock "cinder-quobyte-200507ce-5327-4a2b-966d-508a10a1f525" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] Lock "cinder-quobyte-200507ce-5327-4a2b-966d-508a10a1f525" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d9530c-db2a-4467-871d-ceac23146a01]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-200507ce-5327-4a2b-966d-508a10a1f525 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] Acquiring lock "cinder-329f6cc0-ae81-4ccf-9331-562c968ae489-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] Lock "cinder-329f6cc0-ae81-4ccf-9331-562c968ae489-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] Acquiring lock "cinder-quobyte-329f6cc0-ae81-4ccf-9331-562c968ae489" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] Lock "cinder-quobyte-329f6cc0-ae81-4ccf-9331-562c968ae489" acquired by "delete_volume" :: waited 0.015s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8799c64-aa2a-426c-8328-e1a583b2030a]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:16 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-200507ce-5327-4a2b-966d-508a10a1f525 Apr 16 13:32:16 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:17 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 Apr 16 13:32:17 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:17 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-200507ce-5327-4a2b-966d-508a10a1f525" returned: 0 in 0.475s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-200507ce-5327-4a2b-966d-508a10a1f525 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:17 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-200507ce-5327-4a2b-966d-508a10a1f525 Apr 16 13:32:17 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:17 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489" returned: 0 in 0.492s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:17 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489 Apr 16 13:32:17 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:17 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-200507ce-5327-4a2b-966d-508a10a1f525" returned: 0 in 0.403s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] Lock "cinder-quobyte-200507ce-5327-4a2b-966d-508a10a1f525" released by "delete_volume" :: held 0.907s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] Created reservations ['57ba4e54-9048-47c9-8457-22f17ab7bbd0', '42b58058-1b8f-45e9-915b-4d4bdf04beec', 'f734587e-0a77-4a7d-9f14-68507f3f4411', '497e6814-83da-4a1c-ad1a-6651dcb30d7c'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:17 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:17 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:32:17 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-329f6cc0-ae81-4ccf-9331-562c968ae489" returned: 0 in 0.413s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] Lock "cinder-quobyte-329f6cc0-ae81-4ccf-9331-562c968ae489" released by "delete_volume" :: held 0.929s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] Created reservations ['3c26f2d4-de39-4feb-a4cc-6d7a160240ac', '9185fe8f-4715-44c8-be50-4a5a05175494', '0525d75f-d515-4a5e-8c5b-190a8af84d36', '33212061-f86c-4354-b031-5002313e3213'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:17 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:32:17 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Flow 'volume_create_manager' (7aa74060-d17b-4a4e-bb87-fe7834e796bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b2b4fa-16b2-47a5-a5ef-e24f7397f857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b2b4fa-16b2-47a5-a5ef-e24f7397f857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-733914140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b37387-9901-4de2-bdfc-79b57fb7ee1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf90170908b541b2baf9a76232706df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:18Z,use_quota=True,user_id='87d441be01f546138499651d4ddafa26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8168e8e4-f252-4563-9c62-3853c6ef9e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8168e8e4-f252-4563-9c62-3853c6ef9e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9022f8-9aba-4708-bec2-6e05d79f0161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9022f8-9aba-4708-bec2-6e05d79f0161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7b37387-9901-4de2-bdfc-79b57fb7ee1f', 'volume_name': 'volume-d7b37387-9901-4de2-bdfc-79b57fb7ee1f', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f4d79d-c1cc-4427-b993-aca30383f648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f4d79d-c1cc-4427-b993-aca30383f648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:18 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b166d717-5d8f-40b6-918b-faff40404059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:18 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Volume d7b37387-9901-4de2-bdfc-79b57fb7ee1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7b37387-9901-4de2-bdfc-79b57fb7ee1f', 'volume_size': 1} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-733914140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b37387-9901-4de2-bdfc-79b57fb7ee1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf90170908b541b2baf9a76232706df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:18Z,use_quota=True,user_id='87d441be01f546138499651d4ddafa26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Creating volume d7b37387-9901-4de2-bdfc-79b57fb7ee1f {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:32:18 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d7b37387-9901-4de2-bdfc-79b57fb7ee1f 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.504s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:32:18 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d7b37387-9901-4de2-bdfc-79b57fb7ee1f 1073741824 Apr 16 13:32:18 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:18 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] Deleted volume successfully. Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5afad320-136b-47e6-a406-c12d1c61f47f tempest-VolumeQuotasAdminTestJSON-1861749126 None] Lock "cinder-200507ce-5327-4a2b-966d-508a10a1f525-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:18 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.473s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:32:18 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] Deleted volume successfully. Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c69dd286-1d93-45d7-b224-ddd6830fc93c tempest-VolumesActionsTest-681490842 None] Lock "cinder-329f6cc0-ae81-4ccf-9331-562c968ae489-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:18 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d7b37387-9901-4de2-bdfc-79b57fb7ee1f 1073741824" returned: 0 in 0.512s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d7b37387-9901-4de2-bdfc-79b57fb7ee1f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:18 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d7b37387-9901-4de2-bdfc-79b57fb7ee1f Apr 16 13:32:18 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:19 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d7b37387-9901-4de2-bdfc-79b57fb7ee1f" returned: 0 in 0.476s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:19 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:32:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b166d717-5d8f-40b6-918b-faff40404059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7b37387-9901-4de2-bdfc-79b57fb7ee1f', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b34dfe-dccc-46a4-a49c-65f202fb181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:19 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Volume volume-d7b37387-9901-4de2-bdfc-79b57fb7ee1f (d7b37387-9901-4de2-bdfc-79b57fb7ee1f): created successfully Apr 16 13:32:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b34dfe-dccc-46a4-a49c-65f202fb181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Flow 'volume_create_manager' (7aa74060-d17b-4a4e-bb87-fe7834e796bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:19 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-e0dbe9da-65da-489e-bbbc-dd8d633755a1 tempest-VolumeQuotasAdminTestJSON-1861749126 None] Created volume successfully. Apr 16 13:32:20 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:SELECT=97,cinder:INSERT=20,cinder:UPDATE=117,cinder:DELETE=5 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:32:20 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d4fa05f4-8add-4cd1-86c5-136c1ec81a56 tempest-VolumeQuotasAdminTestJSON-1419659903 None] Transfer volume completed successfully. Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] Acquiring lock "cinder-d7b37387-9901-4de2-bdfc-79b57fb7ee1f-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] Lock "cinder-d7b37387-9901-4de2-bdfc-79b57fb7ee1f-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] Acquiring lock "cinder-quobyte-d7b37387-9901-4de2-bdfc-79b57fb7ee1f" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] Lock "cinder-quobyte-d7b37387-9901-4de2-bdfc-79b57fb7ee1f" acquired by "delete_volume" :: waited 0.015s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef39c3f-9c95-4cb5-b383-6c08df06b755]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d7b37387-9901-4de2-bdfc-79b57fb7ee1f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:21 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d7b37387-9901-4de2-bdfc-79b57fb7ee1f Apr 16 13:32:21 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Flow 'volume_create_manager' (8853bbdb-8ee4-4203-a613-e75c236875cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c986d9-f481-458d-9951-99861e3d2e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c986d9-f481-458d-9951-99861e3d2e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-384754102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918a0b41-8017-4488-b64f-ba832b2fad8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe695030f8a40b9b5ad76caa8aca897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:22Z,use_quota=True,user_id='b844d24b276841fc9d692c69dcbf43df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b593fc-b6c0-4ec4-bc45-1e645c7993cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b593fc-b6c0-4ec4-bc45-1e645c7993cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f35577-8a1a-4e2e-91e1-a2634c648b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f35577-8a1a-4e2e-91e1-a2634c648b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '918a0b41-8017-4488-b64f-ba832b2fad8f', 'volume_name': 'volume-918a0b41-8017-4488-b64f-ba832b2fad8f', 'volume_size': 2}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38fe18a6-b13e-440a-925a-023bedf8e45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38fe18a6-b13e-440a-925a-023bedf8e45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16436142-2634-4ddd-8168-b68e92bad7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:21 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Volume 918a0b41-8017-4488-b64f-ba832b2fad8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-918a0b41-8017-4488-b64f-ba832b2fad8f', 'volume_size': 2} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-384754102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918a0b41-8017-4488-b64f-ba832b2fad8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe695030f8a40b9b5ad76caa8aca897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:22Z,use_quota=True,user_id='b844d24b276841fc9d692c69dcbf43df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Creating volume 918a0b41-8017-4488-b64f-ba832b2fad8f {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:32:21 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:32:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-918a0b41-8017-4488-b64f-ba832b2fad8f 2147483648 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:21 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-918a0b41-8017-4488-b64f-ba832b2fad8f 2147483648 Apr 16 13:32:21 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:22 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d7b37387-9901-4de2-bdfc-79b57fb7ee1f" returned: 0 in 0.500s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d7b37387-9901-4de2-bdfc-79b57fb7ee1f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:22 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d7b37387-9901-4de2-bdfc-79b57fb7ee1f Apr 16 13:32:22 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:22 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-918a0b41-8017-4488-b64f-ba832b2fad8f 2147483648" returned: 0 in 0.498s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-918a0b41-8017-4488-b64f-ba832b2fad8f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:22 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-918a0b41-8017-4488-b64f-ba832b2fad8f Apr 16 13:32:22 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:22 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d7b37387-9901-4de2-bdfc-79b57fb7ee1f" returned: 0 in 0.438s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] Lock "cinder-quobyte-d7b37387-9901-4de2-bdfc-79b57fb7ee1f" released by "delete_volume" :: held 0.962s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] Created reservations ['4d3b06d1-6c05-40a6-ac9e-41f25cace06d', '27f62712-af72-4efa-9497-2710b0fc197a', '1cc80d42-fbc8-48c6-b101-11d6e147a481', 'cfea5461-c681-431a-b9a8-f54f31176eaa'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:22 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:32:22 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:22 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-918a0b41-8017-4488-b64f-ba832b2fad8f" returned: 0 in 0.478s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16436142-2634-4ddd-8168-b68e92bad7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-918a0b41-8017-4488-b64f-ba832b2fad8f', 'volume_size': 2}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2259e25c-d97e-48e5-849c-c62e4dfc45fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:22 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Volume volume-918a0b41-8017-4488-b64f-ba832b2fad8f (918a0b41-8017-4488-b64f-ba832b2fad8f): created successfully Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2259e25c-d97e-48e5-849c-c62e4dfc45fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Flow 'volume_create_manager' (8853bbdb-8ee4-4203-a613-e75c236875cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:22 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-ea464cc3-e756-4177-ac54-7af354e22354 tempest-VolumesCloneNegativeTest-775156978 None] Created volume successfully. Apr 16 13:32:23 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.500s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:23 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:32:23 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] Deleted volume successfully. Apr 16 13:32:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-774b9828-105a-4a0f-ba6b-12e8ebe18112 tempest-VolumeQuotasAdminTestJSON-1688754378 None] Lock "cinder-d7b37387-9901-4de2-bdfc-79b57fb7ee1f-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] Acquiring lock "cinder-918a0b41-8017-4488-b64f-ba832b2fad8f-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] Lock "cinder-918a0b41-8017-4488-b64f-ba832b2fad8f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] Acquiring lock "cinder-quobyte-918a0b41-8017-4488-b64f-ba832b2fad8f" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] Lock "cinder-quobyte-918a0b41-8017-4488-b64f-ba832b2fad8f" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:24 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1f8680-bc46-4a73-9de8-e4d9e40147ff]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-918a0b41-8017-4488-b64f-ba832b2fad8f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:24 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-918a0b41-8017-4488-b64f-ba832b2fad8f Apr 16 13:32:24 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:24 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-918a0b41-8017-4488-b64f-ba832b2fad8f" returned: 0 in 0.528s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-918a0b41-8017-4488-b64f-ba832b2fad8f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:24 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-918a0b41-8017-4488-b64f-ba832b2fad8f Apr 16 13:32:24 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:25 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-918a0b41-8017-4488-b64f-ba832b2fad8f" returned: 0 in 0.474s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:25 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] Lock "cinder-quobyte-918a0b41-8017-4488-b64f-ba832b2fad8f" released by "delete_volume" :: held 1.030s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:25 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] Created reservations ['337569e6-b32d-4313-8ac6-3ddf676026df', '79cbc38f-253f-415d-b80b-bc87b826979b', 'fcc289d6-c2c9-46f1-9feb-13dd5303530c', 'b2a3aae9-4e25-4574-bfa3-b064825bd9eb'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:32:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:25 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:25 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:25 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:32:25 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:25 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.430s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:25 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:32:25 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] Deleted volume successfully. Apr 16 13:32:25 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fcac8b14-7cdf-416c-9e37-5776ec104a61 tempest-VolumesCloneNegativeTest-775156978 None] Lock "cinder-918a0b41-8017-4488-b64f-ba832b2fad8f-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Flow 'volume_create_manager' (9a0f1a53-f1ed-4ce0-8b66-3f4ad5e2b1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e856957-5124-41f4-a9d2-313c7e6d9467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e856957-5124-41f4-a9d2-313c7e6d9467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1906914641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2be61d0-a0b9-4de9-97be-c28a6f84e1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486d6df6b3414c37957bae0f1f284d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:27Z,use_quota=True,user_id='ad17426f9ef94b3fb57de9f530317518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f690217e-6bc3-42c1-a9d5-203d6dd5d45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f690217e-6bc3-42c1-a9d5-203d6dd5d45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a389fc-38b9-4ecb-a398-6739214a3ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a389fc-38b9-4ecb-a398-6739214a3ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2be61d0-a0b9-4de9-97be-c28a6f84e1c9', 'volume_name': 'volume-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fba2bb5-6b29-4e50-bda9-0a437d87cf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fba2bb5-6b29-4e50-bda9-0a437d87cf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8571d2-e960-42ca-856b-331bfdf3782c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:26 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Volume b2be61d0-a0b9-4de9-97be-c28a6f84e1c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9', 'volume_size': 1} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1906914641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2be61d0-a0b9-4de9-97be-c28a6f84e1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486d6df6b3414c37957bae0f1f284d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:27Z,use_quota=True,user_id='ad17426f9ef94b3fb57de9f530317518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Creating volume b2be61d0-a0b9-4de9-97be-c28a6f84e1c9 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:32:26 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:32:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:26 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9 1073741824 Apr 16 13:32:26 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:27 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9 1073741824" returned: 0 in 0.538s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:27 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9 Apr 16 13:32:27 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Flow 'volume_create_manager' (35954bc7-c2b6-4adf-846b-37c6cf831255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55e500e-b51a-454d-80f1-ecf28b3994be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55e500e-b51a-454d-80f1-ecf28b3994be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-744598954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c056f6e-7727-47f3-a713-80a9e65c6d25,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5fce6494e4c04ee682d425d00a6a5115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:28Z,use_quota=True,user_id='2b6413239d344e129af56960ed8788ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1102e59-4384-4283-bf8d-82a22320f44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1102e59-4384-4283-bf8d-82a22320f44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6099f5-dcdf-4ecb-be8e-b59d79aaeab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:27 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6099f5-dcdf-4ecb-be8e-b59d79aaeab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c056f6e-7727-47f3-a713-80a9e65c6d25', 'volume_name': 'volume-2c056f6e-7727-47f3-a713-80a9e65c6d25', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b95d9bb-3d99-4bb8-8198-ec185245eddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b95d9bb-3d99-4bb8-8198-ec185245eddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db58351a-dd39-4f43-9147-afecd6f09929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:27 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Volume 2c056f6e-7727-47f3-a713-80a9e65c6d25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c056f6e-7727-47f3-a713-80a9e65c6d25', 'volume_size': 1} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9" returned: 0 in 0.454s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-744598954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c056f6e-7727-47f3-a713-80a9e65c6d25,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5fce6494e4c04ee682d425d00a6a5115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:28Z,use_quota=True,user_id='2b6413239d344e129af56960ed8788ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Creating volume 2c056f6e-7727-47f3-a713-80a9e65c6d25 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:32:27 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2c056f6e-7727-47f3-a713-80a9e65c6d25 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8571d2-e960-42ca-856b-331bfdf3782c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:27 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2c056f6e-7727-47f3-a713-80a9e65c6d25 1073741824 Apr 16 13:32:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e5da9b-5e6d-4353-9e1c-252510a1acec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:27 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:27 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Volume volume-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9 (b2be61d0-a0b9-4de9-97be-c28a6f84e1c9): created successfully Apr 16 13:32:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e5da9b-5e6d-4353-9e1c-252510a1acec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Flow 'volume_create_manager' (9a0f1a53-f1ed-4ce0-8b66-3f4ad5e2b1bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:28 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-7fba3196-69a7-41d7-a204-c021ec410fe7 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Created volume successfully. Apr 16 13:32:28 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2c056f6e-7727-47f3-a713-80a9e65c6d25 1073741824" returned: 0 in 0.481s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2c056f6e-7727-47f3-a713-80a9e65c6d25 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:28 devstack sudo[89560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2c056f6e-7727-47f3-a713-80a9e65c6d25 Apr 16 13:32:28 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:28 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2c056f6e-7727-47f3-a713-80a9e65c6d25" returned: 0 in 0.416s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:32:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db58351a-dd39-4f43-9147-afecd6f09929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c056f6e-7727-47f3-a713-80a9e65c6d25', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5860e434-fe70-432a-a4c8-0c18c6d9f3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:28 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Volume volume-2c056f6e-7727-47f3-a713-80a9e65c6d25 (2c056f6e-7727-47f3-a713-80a9e65c6d25): created successfully Apr 16 13:32:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5860e434-fe70-432a-a4c8-0c18c6d9f3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Flow 'volume_create_manager' (35954bc7-c2b6-4adf-846b-37c6cf831255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:28 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-5e2cdefe-6ecd-4e8d-a280-b8ac94f74f7d tempest-VolumesGetTest-930736697 None] Created volume successfully. Apr 16 13:32:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Acquiring lock "cinder-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Lock "cinder-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Acquiring lock "cinder-quobyte-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Lock "cinder-quobyte-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:29 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f128e66-a42a-4bfa-bb84-8c23253c4423]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:29 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9 Apr 16 13:32:29 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:30 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9" returned: 0 in 0.483s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:30 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9 Apr 16 13:32:30 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Flow 'volume_create_manager' (c78eae9a-edc1-453f-a92d-2dc861f713b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af67f58-e5cd-4829-abb9-f6e38ac6e5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af67f58-e5cd-4829-abb9-f6e38ac6e5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-903278945',display_name='tempest-VolumesGetTest-Volume-1082529105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d37bc0-0199-47e0-95d8-587ba04e9acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fce6494e4c04ee682d425d00a6a5115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:30Z,use_quota=True,user_id='2b6413239d344e129af56960ed8788ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec008555-7568-40dd-ac1e-66701320ccfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec008555-7568-40dd-ac1e-66701320ccfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5a00ea-0cf8-4c8c-a84d-463363b4c60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5a00ea-0cf8-4c8c-a84d-463363b4c60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d37bc0-0199-47e0-95d8-587ba04e9acb', 'volume_name': 'volume-17d37bc0-0199-47e0-95d8-587ba04e9acb', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b673584f-ec10-4563-89e8-16951639fb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b673584f-ec10-4563-89e8-16951639fb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531b9acd-59ab-4253-937d-67eaa41d4420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:30 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Volume 17d37bc0-0199-47e0-95d8-587ba04e9acb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d37bc0-0199-47e0-95d8-587ba04e9acb', 'volume_size': 1} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-903278945',display_name='tempest-VolumesGetTest-Volume-1082529105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d37bc0-0199-47e0-95d8-587ba04e9acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fce6494e4c04ee682d425d00a6a5115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:30Z,use_quota=True,user_id='2b6413239d344e129af56960ed8788ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Creating volume 17d37bc0-0199-47e0-95d8-587ba04e9acb {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:32:30 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-17d37bc0-0199-47e0-95d8-587ba04e9acb 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:30 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-17d37bc0-0199-47e0-95d8-587ba04e9acb 1073741824 Apr 16 13:32:30 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:30 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9" returned: 0 in 0.429s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Lock "cinder-quobyte-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9" released by "delete_volume" :: held 0.958s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Created reservations ['1ad85c3c-953f-4498-bc2a-295cf2785aec', '3cb69194-c146-4ab7-8a5f-7ab70a4abf06', '5de26d5e-7921-43f5-88db-5077a45ac39f', 'ef4cf7fd-3f88-49b1-b6ac-a4db279d3ce1'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:30 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:32:30 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:30 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-17d37bc0-0199-47e0-95d8-587ba04e9acb 1073741824" returned: 0 in 0.543s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-17d37bc0-0199-47e0-95d8-587ba04e9acb {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:31 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-17d37bc0-0199-47e0-95d8-587ba04e9acb Apr 16 13:32:31 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:31 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.571s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:31 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:32:31 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Deleted volume successfully. Apr 16 13:32:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8c6d5ab2-2fb0-4550-ba16-f9664b651d81 tempest-VolumeQuotasNegativeTestJSON-290465645 None] Lock "cinder-b2be61d0-a0b9-4de9-97be-c28a6f84e1c9-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:31 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-17d37bc0-0199-47e0-95d8-587ba04e9acb" returned: 0 in 0.440s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:31 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:32:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:31 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531b9acd-59ab-4253-937d-67eaa41d4420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d37bc0-0199-47e0-95d8-587ba04e9acb', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:31 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fb4616-6b25-4194-ab81-926957040fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:31 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Volume volume-17d37bc0-0199-47e0-95d8-587ba04e9acb (17d37bc0-0199-47e0-95d8-587ba04e9acb): created successfully Apr 16 13:32:31 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fb4616-6b25-4194-ab81-926957040fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:31 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Flow 'volume_create_manager' (c78eae9a-edc1-453f-a92d-2dc861f713b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:31 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-c1689e00-a880-41e9-b723-338ca0580263 tempest-VolumesGetTest-930736697 None] Created volume successfully. Apr 16 13:32:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] Acquiring lock "cinder-17d37bc0-0199-47e0-95d8-587ba04e9acb-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] Lock "cinder-17d37bc0-0199-47e0-95d8-587ba04e9acb-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] Acquiring lock "cinder-quobyte-17d37bc0-0199-47e0-95d8-587ba04e9acb" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-17d37bc0-0199-47e0-95d8-587ba04e9acb" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:32 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e07c0a-4c71-4690-9ce9-d0701413f144]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-17d37bc0-0199-47e0-95d8-587ba04e9acb {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:32 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-17d37bc0-0199-47e0-95d8-587ba04e9acb Apr 16 13:32:32 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:33 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-17d37bc0-0199-47e0-95d8-587ba04e9acb" returned: 0 in 0.510s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-17d37bc0-0199-47e0-95d8-587ba04e9acb {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:33 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-17d37bc0-0199-47e0-95d8-587ba04e9acb Apr 16 13:32:33 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:33 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-17d37bc0-0199-47e0-95d8-587ba04e9acb" returned: 0 in 0.441s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:33 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-17d37bc0-0199-47e0-95d8-587ba04e9acb" released by "delete_volume" :: held 0.982s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:33 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] Created reservations ['2d8667d9-67fc-4b79-bcd4-3e4765dcaa47', '6f3fbb6b-f09c-4c0a-a922-81aacf40265d', '57da4d69-df85-4998-bcde-be62399be46f', 'fd92b9a0-8e41-4d34-a42a-78496967169d'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:32:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:33 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:33 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:33 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:32:33 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:34 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.497s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:34 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:32:34 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] Deleted volume successfully. Apr 16 13:32:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d148eddc-1ee6-403c-8da2-56e62839e31b tempest-VolumesGetTest-930736697 None] Lock "cinder-17d37bc0-0199-47e0-95d8-587ba04e9acb-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:34 devstack cinder-volume[83606]: DEBUG oslo_service.periodic_task [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83606) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 13:32:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:34 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:32:34 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] Acquiring lock "cinder-2c056f6e-7727-47f3-a713-80a9e65c6d25-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] Lock "cinder-2c056f6e-7727-47f3-a713-80a9e65c6d25-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] Acquiring lock "cinder-quobyte-2c056f6e-7727-47f3-a713-80a9e65c6d25" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-2c056f6e-7727-47f3-a713-80a9e65c6d25" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:34 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebb9c82-3a0d-49c6-a4a7-df59714e22cc]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2c056f6e-7727-47f3-a713-80a9e65c6d25 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:34 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2c056f6e-7727-47f3-a713-80a9e65c6d25 Apr 16 13:32:34 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:35 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.517s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:35 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:32:35 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2c056f6e-7727-47f3-a713-80a9e65c6d25" returned: 0 in 0.558s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2c056f6e-7727-47f3-a713-80a9e65c6d25 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:35 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2c056f6e-7727-47f3-a713-80a9e65c6d25 Apr 16 13:32:35 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:35 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2c056f6e-7727-47f3-a713-80a9e65c6d25" returned: 0 in 0.473s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:35 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-2c056f6e-7727-47f3-a713-80a9e65c6d25" released by "delete_volume" :: held 1.061s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:35 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] Created reservations ['aed66866-1b87-4921-a582-d118c9921c8d', '6923e7ef-fc66-4037-a071-1c63a814e1cc', 'dabfa0cb-990b-4dad-9794-462dd40b45d3', 'bd33b6cc-ff0a-44ef-8a79-164f525ebbbb'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:32:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:36 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:32:36 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:36 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.460s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:36 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:32:36 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] Deleted volume successfully. Apr 16 13:32:36 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-287b754a-475c-471a-a0e5-675a18216c09 tempest-VolumesGetTest-930736697 None] Lock "cinder-2c056f6e-7727-47f3-a713-80a9e65c6d25-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Flow 'volume_create_manager' (008d8e7c-1911-42c1-b0c3-fa6c43af1be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17353144-4aa2-4ddc-905c-a98210da914a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17353144-4aa2-4ddc-905c-a98210da914a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1062403937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29723bc7-fc54-47a5-9217-6834c72fa0b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fce6494e4c04ee682d425d00a6a5115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:37Z,use_quota=True,user_id='2b6413239d344e129af56960ed8788ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308ad4fa-f41a-4490-a9de-b221818c999b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308ad4fa-f41a-4490-a9de-b221818c999b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4a4a14-3d7d-4c44-bbed-de4922249ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4a4a14-3d7d-4c44-bbed-de4922249ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29723bc7-fc54-47a5-9217-6834c72fa0b0', 'volume_name': 'volume-29723bc7-fc54-47a5-9217-6834c72fa0b0', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb056ab-54f4-4ac8-a61a-b81a44c0d5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb056ab-54f4-4ac8-a61a-b81a44c0d5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c6b3b1-832c-44af-b14a-e77c184218e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:37 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Volume 29723bc7-fc54-47a5-9217-6834c72fa0b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29723bc7-fc54-47a5-9217-6834c72fa0b0', 'volume_size': 1} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1062403937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29723bc7-fc54-47a5-9217-6834c72fa0b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fce6494e4c04ee682d425d00a6a5115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:37Z,use_quota=True,user_id='2b6413239d344e129af56960ed8788ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Creating volume 29723bc7-fc54-47a5-9217-6834c72fa0b0 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:32:37 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:37 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 1073741824 Apr 16 13:32:37 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:37 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 1073741824" returned: 0 in 0.556s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:37 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 Apr 16 13:32:37 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:38 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0" returned: 0 in 0.465s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:38 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:32:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c6b3b1-832c-44af-b14a-e77c184218e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29723bc7-fc54-47a5-9217-6834c72fa0b0', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d4afca-c20b-4dfe-bca4-4c899c0e9e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:38 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Volume volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 (29723bc7-fc54-47a5-9217-6834c72fa0b0): created successfully Apr 16 13:32:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d4afca-c20b-4dfe-bca4-4c899c0e9e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Flow 'volume_create_manager' (008d8e7c-1911-42c1-b0c3-fa6c43af1be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:38 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-a07ad8af-7555-4906-8243-98fcd2de6a19 tempest-VolumesGetTest-930736697 None] Created volume successfully. Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Flow 'volume_create_manager' (deac3c3f-a374-4729-9ae1-33b96cf7cfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67e077b-8938-4d22-a404-8c3950dbba3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67e077b-8938-4d22-a404-8c3950dbba3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-394391090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55450774-fdec-406d-9b29-ea0009fc3d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313a415332bc440498ce02a67c4a9945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:39Z,use_quota=True,user_id='e406334231b34a1a8aff06d2348d6880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10ff999-cdcc-418e-ac62-f70ec6577a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10ff999-cdcc-418e-ac62-f70ec6577a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a53701-1b27-4497-8282-d3192f6f7a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.image.glance [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Creating Keystone auth plugin from conf {{(pid=83606) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a53701-1b27-4497-8282-d3192f6f7a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '55450774-fdec-406d-9b29-ea0009fc3d96', 'volume_name': 'volume-55450774-fdec-406d-9b29-ea0009fc3d96', 'volume_size': 1, 'image_id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4eb13d7d316f41debb8154b9017521da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'created_at': datetime.datetime(2026, 4, 16, 11, 21, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 11, 21, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7009feaa-0e6c-4162-a140-3396f105b821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7009feaa-0e6c-4162-a140-3396f105b821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07c61be-6410-4092-b871-7600042d51ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:39 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Volume 55450774-fdec-406d-9b29-ea0009fc3d96: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-55450774-fdec-406d-9b29-ea0009fc3d96', 'volume_size': 1, 'image_id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4eb13d7d316f41debb8154b9017521da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'created_at': datetime.datetime(2026, 4, 16, 11, 21, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 11, 21, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Trying to clone 55450774-fdec-406d-9b29-ea0009fc3d96 from image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}]). {{(pid=83606) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_s1mzjpn_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83606) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 13:32:39 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Image download 20.69 MB at 20.69 MB/s Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3739bddc-027e-433d-add0-9e0d56793279]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_s1mzjpn_devstack@QuobyteHD {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Flow 'volume_create_manager' (81b24229-03d3-4e3c-adad-fa60f230ac5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0872069f-7c91-4ee0-b4d6-664b0a786550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0872069f-7c91-4ee0-b4d6-664b0a786550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-32242979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65f72cb-326e-4921-9e34-c7b9e67355be,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5fce6494e4c04ee682d425d00a6a5115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=29723bc7-fc54-47a5-9217-6834c72fa0b0,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:40Z,use_quota=True,user_id='2b6413239d344e129af56960ed8788ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a72b4a-cd0c-46a4-9f57-05937a95df24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:39 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_s1mzjpn_devstack@QuobyteHD Apr 16 13:32:39 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a72b4a-cd0c-46a4-9f57-05937a95df24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da5f5292-13a1-48bf-baaf-75c94846743d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da5f5292-13a1-48bf-baaf-75c94846743d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a65f72cb-326e-4921-9e34-c7b9e67355be', 'volume_name': 'volume-a65f72cb-326e-4921-9e34-c7b9e67355be', 'volume_size': 1, 'source_volid': '29723bc7-fc54-47a5-9217-6834c72fa0b0', 'source_volstatus': 'available'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c13e5d4-ed2e-4b4e-bfbe-3fecd36c85e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c13e5d4-ed2e-4b4e-bfbe-3fecd36c85e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24227c1e-44be-4c14-a9f9-9607bb6246aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:39 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Volume a65f72cb-326e-4921-9e34-c7b9e67355be: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a65f72cb-326e-4921-9e34-c7b9e67355be', 'volume_size': 1, 'source_volid': '29723bc7-fc54-47a5-9217-6834c72fa0b0', 'source_volstatus': 'available'} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:39 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Cloning volume 29723bc7-fc54-47a5-9217-6834c72fa0b0 to volume a65f72cb-326e-4921-9e34-c7b9e67355be Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Creating offline snapshot 2301676e-bdf7-45ce-a98f-8f0f1732ee01 of volume 29723bc7-fc54-47a5-9217-6834c72fa0b0 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e2d151-191f-4145-8aa0-ea1921c61dfb]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:39 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 Apr 16 13:32:39 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:40 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_s1mzjpn_devstack@QuobyteHD" returned: 0 in 0.464s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:40 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Temporary image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 is fetched for user e406334231b34a1a8aff06d2348d6880. {{(pid=83606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 13:32:40 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a0948e-5ad0-443f-a55a-c8b093d8f29e]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_s1mzjpn_devstack@QuobyteHD {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:40 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_s1mzjpn_devstack@QuobyteHD Apr 16 13:32:40 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:40 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0" returned: 0 in 0.493s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:40 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01 1G Apr 16 13:32:40 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:40 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_s1mzjpn_devstack@QuobyteHD" returned: 0 in 0.462s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:40 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01 1G" returned: 0 in 0.493s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:40 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01 Apr 16 13:32:40 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:41 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01" returned: 0 in 0.434s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:41 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01 is being set with open permissions: ugo+rw Apr 16 13:32:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:41 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01 Apr 16 13:32:41 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:41 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01" returned: 0 in 0.411s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:41 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.info Apr 16 13:32:41 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:42 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.info" returned: 0 in 0.424s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:42 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.info is being set with open permissions: ugo+rw Apr 16 13:32:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:42 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.info Apr 16 13:32:42 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:42 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.info" returned: 0 in 0.407s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:42 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Acquiring lock "cinder-quobyte-a65f72cb-326e-4921-9e34-c7b9e67355be" by "_copy_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:42 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-a65f72cb-326e-4921-9e34-c7b9e67355be" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] snapshot: 2301676e-bdf7-45ce-a98f-8f0f1732ee01, volume: a65f72cb-326e-4921-9e34-c7b9e67355be, {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 13:32:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:42 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e47b952-0d10-47c4-a204-0adedc3b75c3]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:42 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01 Apr 16 13:32:42 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:43 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01" returned: 0 in 0.493s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29723bc7-fc54-47a5-9217-6834c72fa0b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:32:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 13:32:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Creating direct copy from snapshot {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 13:32:43 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dc3a16-80bf-45c0-8c84-d580e4dad708]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:43 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 Apr 16 13:32:43 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:43 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0" returned: 0 in 0.485s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:43 devstack cinder-volume[83606]: DEBUG cinder.utils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Path /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a65f72cb-326e-4921-9e34-c7b9e67355be not found in is_blk_device check {{(pid=83606) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 13:32:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a65f72cb-326e-4921-9e34-c7b9e67355be {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:43 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a65f72cb-326e-4921-9e34-c7b9e67355be Apr 16 13:32:43 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:45 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a65f72cb-326e-4921-9e34-c7b9e67355be" returned: 0 in 1.926s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:45 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[206210c1-a6d5-49f0-a997-b7593fdcb31b]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:45 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 Apr 16 13:32:45 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:46 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0" returned: 0 in 0.586s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:46 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Image conversion details: src /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0, size 1024.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a65f72cb-326e-4921-9e34-c7b9e67355be {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:32:46 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Converted 1024.00 MB image at 531.35 MB/s Apr 16 13:32:46 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a65f72cb-326e-4921-9e34-c7b9e67355be is being set with open permissions: ugo+rw Apr 16 13:32:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a65f72cb-326e-4921-9e34-c7b9e67355be {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:46 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a65f72cb-326e-4921-9e34-c7b9e67355be Apr 16 13:32:46 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:46 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a65f72cb-326e-4921-9e34-c7b9e67355be" returned: 0 in 0.399s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:46 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-a65f72cb-326e-4921-9e34-c7b9e67355be" released by "_copy_volume_from_snapshot" :: held 3.934s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:46 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Acquiring lock "cinder-quobyte-2301676e-bdf7-45ce-a98f-8f0f1732ee01" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:46 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-2301676e-bdf7-45ce-a98f-8f0f1732ee01" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Deleting offline snapshot 2301676e-bdf7-45ce-a98f-8f0f1732ee01 of volume 29723bc7-fc54-47a5-9217-6834c72fa0b0 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:32:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] snapshot_file for this snap is: volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:32:46 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1897eadb-cfab-413b-a810-fdf5135b9a1d]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:46 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01 Apr 16 13:32:46 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:46 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01" returned: 0 in 0.478s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29723bc7-fc54-47a5-9217-6834c72fa0b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:32:46 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b07a54-337c-43dd-92cc-d8a8ba2ba8b0]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:47 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 Apr 16 13:32:47 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:47 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0" returned: 0 in 0.466s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:47 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01 Apr 16 13:32:47 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:47 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01" returned: 0 in 0.448s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:47 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01 Apr 16 13:32:47 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:48 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0.2301676e-bdf7-45ce-a98f-8f0f1732ee01" returned: 0 in 0.420s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-2301676e-bdf7-45ce-a98f-8f0f1732ee01" released by "_delete_snapshot" :: held 1.861s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.568s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.705s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-394391090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55450774-fdec-406d-9b29-ea0009fc3d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313a415332bc440498ce02a67c4a9945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:39Z,use_quota=True,user_id='e406334231b34a1a8aff06d2348d6880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Creating volume 55450774-fdec-406d-9b29-ea0009fc3d96 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:32:48 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24227c1e-44be-4c14-a9f9-9607bb6246aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a65f72cb-326e-4921-9e34-c7b9e67355be', 'volume_size': 1, 'source_volid': '29723bc7-fc54-47a5-9217-6834c72fa0b0', 'source_volstatus': 'available'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:48 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 1073741824 Apr 16 13:32:48 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a425bed1-67b5-40b0-ba31-f9289afc6d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:48 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Volume volume-a65f72cb-326e-4921-9e34-c7b9e67355be (a65f72cb-326e-4921-9e34-c7b9e67355be): created successfully Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a425bed1-67b5-40b0-ba31-f9289afc6d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Flow 'volume_create_manager' (81b24229-03d3-4e3c-adad-fa60f230ac5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:48 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-3a207a15-322c-471d-b552-4f10b40adeef tempest-VolumesGetTest-930736697 None] Created volume successfully. Apr 16 13:32:48 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 1073741824" returned: 0 in 0.487s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:48 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 Apr 16 13:32:48 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:49 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96" returned: 0 in 0.436s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.volume_utils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Attempting download of 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}])) to volume 55450774-fdec-406d-9b29-ea0009fc3d96. {{(pid=83606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[39aa460f-8ec5-4a04-b75f-0f12b7eb4ad6]: (4, 'raw') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_6zfo0o81 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:49 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_6zfo0o81 Apr 16 13:32:49 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Flow 'volume_create_manager' (6edd135b-10a4-49f9-86b8-10f5d901efb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58fc4eea-a2db-465d-b305-3c9768e5b3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58fc4eea-a2db-465d-b305-3c9768e5b3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1282171131',display_name='tempest-VolumesGetTest-Volume-822288931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d121498-c263-43c5-913c-7d4fa5b25f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fce6494e4c04ee682d425d00a6a5115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:49Z,use_quota=True,user_id='2b6413239d344e129af56960ed8788ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b270c80-d173-448f-a959-e020f80575c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b270c80-d173-448f-a959-e020f80575c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c16723-39c3-47cd-8dc9-b0606da888b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c16723-39c3-47cd-8dc9-b0606da888b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d121498-c263-43c5-913c-7d4fa5b25f40', 'volume_name': 'volume-5d121498-c263-43c5-913c-7d4fa5b25f40', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfb9cfa-8459-4cc3-ab6e-fbb96d2fc448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfb9cfa-8459-4cc3-ab6e-fbb96d2fc448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b1a341-f009-4fca-824e-ae7fc7ee4be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:49 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Volume 5d121498-c263-43c5-913c-7d4fa5b25f40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d121498-c263-43c5-913c-7d4fa5b25f40', 'volume_size': 1} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1282171131',display_name='tempest-VolumesGetTest-Volume-822288931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d121498-c263-43c5-913c-7d4fa5b25f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fce6494e4c04ee682d425d00a6a5115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:49Z,use_quota=True,user_id='2b6413239d344e129af56960ed8788ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Creating volume 5d121498-c263-43c5-913c-7d4fa5b25f40 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:32:49 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5d121498-c263-43c5-913c-7d4fa5b25f40 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:49 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5d121498-c263-43c5-913c-7d4fa5b25f40 1073741824 Apr 16 13:32:49 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:49 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_6zfo0o81" returned: 0 in 0.517s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_6zfo0o81 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:49 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_6zfo0o81 Apr 16 13:32:49 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:50 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5d121498-c263-43c5-913c-7d4fa5b25f40 1073741824" returned: 0 in 0.494s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5d121498-c263-43c5-913c-7d4fa5b25f40 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:50 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5d121498-c263-43c5-913c-7d4fa5b25f40 Apr 16 13:32:50 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:50 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_6zfo0o81" returned: 1 in 0.479s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_6zfo0o81' failed. Not Retrying. {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 13:32:50 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4263a4-52e4-4a56-865e-8fbb815e2418]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_s1mzjpn_devstack@QuobyteHD {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:50 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_s1mzjpn_devstack@QuobyteHD Apr 16 13:32:50 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:50 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5d121498-c263-43c5-913c-7d4fa5b25f40" returned: 0 in 0.417s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:50 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:32:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:50 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b1a341-f009-4fca-824e-ae7fc7ee4be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d121498-c263-43c5-913c-7d4fa5b25f40', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:50 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfb43a4-42d8-41f2-a848-a565ae91dbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:50 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Volume volume-5d121498-c263-43c5-913c-7d4fa5b25f40 (5d121498-c263-43c5-913c-7d4fa5b25f40): created successfully Apr 16 13:32:50 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfb43a4-42d8-41f2-a848-a565ae91dbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:50 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Flow 'volume_create_manager' (6edd135b-10a4-49f9-86b8-10f5d901efb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:50 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-e76e4d24-e232-469b-9104-dcb6fb0a31c1 tempest-VolumesGetTest-930736697 None] Created volume successfully. Apr 16 13:32:50 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_s1mzjpn_devstack@QuobyteHD" returned: 0 in 0.456s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:50 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 was qcow2, converting to raw {{(pid=83606) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 13:32:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_s1mzjpn_devstack@QuobyteHD /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:50 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_s1mzjpn_devstack@QuobyteHD /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 Apr 16 13:32:50 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:51 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_s1mzjpn_devstack@QuobyteHD /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96" returned: 0 in 0.851s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:51 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_s1mzjpn_devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:32:51 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Converted 112.00 MB image at 112.00 MB/s Apr 16 13:32:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:51 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 1G Apr 16 13:32:51 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] Acquiring lock "cinder-5d121498-c263-43c5-913c-7d4fa5b25f40-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] Lock "cinder-5d121498-c263-43c5-913c-7d4fa5b25f40-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] Acquiring lock "cinder-quobyte-5d121498-c263-43c5-913c-7d4fa5b25f40" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-5d121498-c263-43c5-913c-7d4fa5b25f40" acquired by "delete_volume" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:51 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[967039c2-37d7-4220-acef-05a818651eb9]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5d121498-c263-43c5-913c-7d4fa5b25f40 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:51 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5d121498-c263-43c5-913c-7d4fa5b25f40 Apr 16 13:32:51 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:52 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 1G" returned: 0 in 0.451s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65903c0-bc0d-43b1-9061-d07f28396267]: (4, 'raw') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:52 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 Apr 16 13:32:52 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:52 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5d121498-c263-43c5-913c-7d4fa5b25f40" returned: 0 in 0.490s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5d121498-c263-43c5-913c-7d4fa5b25f40 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:52 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5d121498-c263-43c5-913c-7d4fa5b25f40 Apr 16 13:32:52 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:52 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96" returned: 0 in 0.468s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:52 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:52 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 Apr 16 13:32:52 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5d121498-c263-43c5-913c-7d4fa5b25f40" returned: 0 in 0.431s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-5d121498-c263-43c5-913c-7d4fa5b25f40" released by "delete_volume" :: held 0.943s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] Created reservations ['4250720f-3f46-4885-b4a8-2bf75a198834', '338be7e8-887a-442a-a513-2d8cca47e90f', '68f94dd2-8329-4c59-9061-e707de624d48', '419af6d8-081e-4fb4-af0c-0dd15932a103'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:52 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:32:52 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] Acquiring lock "cinder-a65f72cb-326e-4921-9e34-c7b9e67355be-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] Lock "cinder-a65f72cb-326e-4921-9e34-c7b9e67355be-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] Acquiring lock "cinder-quobyte-a65f72cb-326e-4921-9e34-c7b9e67355be" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-a65f72cb-326e-4921-9e34-c7b9e67355be" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25e4dd8-4241-48e8-8138-dc5528cce9e8]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a65f72cb-326e-4921-9e34-c7b9e67355be {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:53 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a65f72cb-326e-4921-9e34-c7b9e67355be Apr 16 13:32:53 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:53 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96" returned: 1 in 0.544s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96' failed. Not Retrying. {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG cinder.volume.volume_utils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Downloaded image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}])) to volume 55450774-fdec-406d-9b29-ea0009fc3d96 successfully. {{(pid=83606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Temporary image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 for user e406334231b34a1a8aff06d2348d6880 is deleted. {{(pid=83606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG cinder.volume.volume_utils [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Marking volume 55450774-fdec-406d-9b29-ea0009fc3d96 as bootable. {{(pid=83606) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Copying metadata from image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 to 55450774-fdec-406d-9b29-ea0009fc3d96. {{(pid=83606) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Creating volume glance metadata for volume 55450774-fdec-406d-9b29-ea0009fc3d96 backed by image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83606) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07c61be-6410-4092-b871-7600042d51ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55450774-fdec-406d-9b29-ea0009fc3d96', 'volume_size': 1, 'image_id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4eb13d7d316f41debb8154b9017521da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'created_at': datetime.datetime(2026, 4, 16, 11, 21, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 11, 21, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec6ac31-cbbe-4fcd-9b78-509f76ed23b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:53 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Volume volume-55450774-fdec-406d-9b29-ea0009fc3d96 (55450774-fdec-406d-9b29-ea0009fc3d96): created successfully Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec6ac31-cbbe-4fcd-9b78-509f76ed23b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Flow 'volume_create_manager' (deac3c3f-a374-4729-9ae1-33b96cf7cfec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:53 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-e53d8266-0a40-45b1-802e-162a8f530148 tempest-VolumesImageMetadata-1044308102 None] Created volume successfully. Apr 16 13:32:53 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.483s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:32:53 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] Deleted volume successfully. Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1a131e62-b9a6-4b16-89f7-8bccd8560a55 tempest-VolumesGetTest-930736697 None] Lock "cinder-5d121498-c263-43c5-913c-7d4fa5b25f40-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:53 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a65f72cb-326e-4921-9e34-c7b9e67355be" returned: 0 in 0.488s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a65f72cb-326e-4921-9e34-c7b9e67355be {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:53 devstack sudo[89774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a65f72cb-326e-4921-9e34-c7b9e67355be Apr 16 13:32:53 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:53 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a65f72cb-326e-4921-9e34-c7b9e67355be" returned: 0 in 0.414s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-a65f72cb-326e-4921-9e34-c7b9e67355be" released by "delete_volume" :: held 0.941s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] Created reservations ['8af6e091-6231-426e-9f12-a8fd0966f003', 'e4041d2d-3524-4427-a536-473774f96801', 'e3f6abc8-0d74-4666-8224-3b403ec6a067', '2c699325-b431-43b4-8102-7bae5e94d969'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:53 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:32:53 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] Acquiring lock "cinder-29723bc7-fc54-47a5-9217-6834c72fa0b0-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] Lock "cinder-29723bc7-fc54-47a5-9217-6834c72fa0b0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] Acquiring lock "cinder-quobyte-29723bc7-fc54-47a5-9217-6834c72fa0b0" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-29723bc7-fc54-47a5-9217-6834c72fa0b0" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[98134a80-0b7e-48ae-8e06-0f162ca4d489]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:54 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 Apr 16 13:32:54 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Acquiring lock "cinder-55450774-fdec-406d-9b29-ea0009fc3d96-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Lock "cinder-55450774-fdec-406d-9b29-ea0009fc3d96-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Acquiring lock "cinder-quobyte-55450774-fdec-406d-9b29-ea0009fc3d96" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Lock "cinder-quobyte-55450774-fdec-406d-9b29-ea0009fc3d96" acquired by "delete_volume" :: waited 0.020s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:32:54 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.472s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:32:54 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] Deleted volume successfully. Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-80531cb2-4267-48c6-9d8d-2f8a943a2c83 tempest-VolumesGetTest-930736697 None] Lock "cinder-a65f72cb-326e-4921-9e34-c7b9e67355be-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ba0c34-14d7-46c4-9c59-235c49f527fe]: (4, 'raw') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:54 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 Apr 16 13:32:54 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:54 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0" returned: 0 in 0.551s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:54 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0 Apr 16 13:32:54 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:54 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96" returned: 0 in 0.477s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:54 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 Apr 16 13:32:54 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:55 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-29723bc7-fc54-47a5-9217-6834c72fa0b0" returned: 0 in 0.419s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-29723bc7-fc54-47a5-9217-6834c72fa0b0" released by "delete_volume" :: held 1.003s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] Created reservations ['e1987e85-1e05-4477-b975-8b772302984d', 'de7f2ad3-269d-44d6-87e9-c8c69dab85e3', '759eb775-117e-4745-b83a-adf7fca7c1ea', '2e5cce70-2609-4d8f-bb41-0c2e72f791a5'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:55 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:32:55 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:55 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96" returned: 1 in 0.503s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96' failed. Not Retrying. {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:55 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96 Apr 16 13:32:55 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:55 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.419s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:32:55 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] Deleted volume successfully. Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e9f0bcca-0de9-49b3-853c-62e31b4e04d2 tempest-VolumesGetTest-930736697 None] Lock "cinder-29723bc7-fc54-47a5-9217-6834c72fa0b0-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:55 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55450774-fdec-406d-9b29-ea0009fc3d96" returned: 0 in 0.418s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Lock "cinder-quobyte-55450774-fdec-406d-9b29-ea0009fc3d96" released by "delete_volume" :: held 1.442s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Created reservations ['e4c8cba4-a6e9-4565-b180-0f1039e0ac15', '6eea7201-e44f-4caa-8ffb-c4267c1a8b69', 'cbb14c6c-b45c-41b2-97e1-b6d0d562bb1d', 'b67b797e-87a3-4d4e-848c-08dd2f2b1da1'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:55 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:32:55 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:56 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.441s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:56 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:32:56 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Deleted volume successfully. Apr 16 13:32:56 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-88ef5da5-ddec-4433-8d50-e3da4b948e6e tempest-VolumesImageMetadata-1044308102 None] Lock "cinder-55450774-fdec-406d-9b29-ea0009fc3d96-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:32:56 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:32:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Flow 'volume_create_manager' (744bfc62-db28-407b-8f3a-ac8561d224b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:32:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7875c4-76fa-4c0b-8066-5c2a235e772a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7875c4-76fa-4c0b-8066-5c2a235e772a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1091015321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5fafb6-87f9-4dd1-acf1-111861b590b4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5fce6494e4c04ee682d425d00a6a5115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:57Z,use_quota=True,user_id='2b6413239d344e129af56960ed8788ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ac63bf-16f1-459e-9d42-bc59deb921ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ac63bf-16f1-459e-9d42-bc59deb921ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a568c45b-7a25-482d-bb3e-c2d2b82a7ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:56 devstack cinder-volume[83606]: DEBUG cinder.image.glance [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Creating Keystone auth plugin from conf {{(pid=83606) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 13:32:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a568c45b-7a25-482d-bb3e-c2d2b82a7ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1d5fafb6-87f9-4dd1-acf1-111861b590b4', 'volume_name': 'volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4', 'volume_size': 1, 'image_id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4eb13d7d316f41debb8154b9017521da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'created_at': datetime.datetime(2026, 4, 16, 11, 21, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 11, 21, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057ba46b-e7a9-42c0-9722-9c61bb220d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057ba46b-e7a9-42c0-9722-9c61bb220d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:32:56 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77dd4f80-c0e5-4cf3-a746-0ec858ad8068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:32:56 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Volume 1d5fafb6-87f9-4dd1-acf1-111861b590b4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4', 'volume_size': 1, 'image_id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4eb13d7d316f41debb8154b9017521da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'created_at': datetime.datetime(2026, 4, 16, 11, 21, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 11, 21, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 13:32:56 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Trying to clone 1d5fafb6-87f9-4dd1-acf1-111861b590b4 from image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}]). {{(pid=83606) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 13:32:57 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_k0hmgeh3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83606) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 13:32:57 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Image download 20.69 MB at 20.69 MB/s Apr 16 13:32:57 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[08545ee5-e47e-4921-8098-7c861b624a7f]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_k0hmgeh3devstack@QuobyteHD {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:57 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_k0hmgeh3devstack@QuobyteHD Apr 16 13:32:57 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:57 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_k0hmgeh3devstack@QuobyteHD" returned: 0 in 0.511s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:57 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Temporary image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 is fetched for user 2b6413239d344e129af56960ed8788ea. {{(pid=83606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 13:32:57 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[67656738-9ef3-410c-9a46-8ce4849e2d70]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_k0hmgeh3devstack@QuobyteHD {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:57 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_k0hmgeh3devstack@QuobyteHD Apr 16 13:32:57 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:58 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_k0hmgeh3devstack@QuobyteHD" returned: 0 in 0.506s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1091015321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5fafb6-87f9-4dd1-acf1-111861b590b4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5fce6494e4c04ee682d425d00a6a5115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:32:57Z,use_quota=True,user_id='2b6413239d344e129af56960ed8788ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:32:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Creating volume 1d5fafb6-87f9-4dd1-acf1-111861b590b4 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:32:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:32:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:32:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:32:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:32:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:32:58 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:32:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:58 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 1073741824 Apr 16 13:32:58 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:58 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 1073741824" returned: 0 in 0.509s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:58 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 Apr 16 13:32:58 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:59 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4" returned: 0 in 0.423s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:32:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:32:59 devstack cinder-volume[83606]: DEBUG cinder.volume.volume_utils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Attempting download of 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}])) to volume 1d5fafb6-87f9-4dd1-acf1-111861b590b4. {{(pid=83606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 13:32:59 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2229760-7261-48e2-b6f5-11580cafb427]: (4, 'raw') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:32:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_3tsl1_x8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:59 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_3tsl1_x8 Apr 16 13:32:59 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:32:59 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Apr 16 13:32:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_3tsl1_x8" returned: 0 in 0.478s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:32:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_3tsl1_x8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:32:59 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_3tsl1_x8 Apr 16 13:32:59 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:00 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_3tsl1_x8" returned: 1 in 0.479s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_3tsl1_x8' failed. Not Retrying. {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0414835a-0907-41cf-a417-a7c9e976641d]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_k0hmgeh3devstack@QuobyteHD {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:00 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_k0hmgeh3devstack@QuobyteHD Apr 16 13:33:00 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:33:00 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Flow 'volume_create_manager' (7ff55c00-2562-4404-952b-df34e93a5f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66dd69a0-50f1-459b-9889-79d9cdf16b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_k0hmgeh3devstack@QuobyteHD" returned: 0 in 0.526s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 was qcow2, converting to raw {{(pid=83606) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_k0hmgeh3devstack@QuobyteHD /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:00 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_k0hmgeh3devstack@QuobyteHD /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 Apr 16 13:33:00 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66dd69a0-50f1-459b-9889-79d9cdf16b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1409290317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e3862f-4cb2-4dac-a43f-6003fdae67e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6f5b4c12f7422f91a7659cab1c4dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:01Z,use_quota=True,user_id='8e3a0c07a13442f0b5fefe5db0588993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529e4a9b-ef3f-447b-9bdf-f20fc45fb751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529e4a9b-ef3f-447b-9bdf-f20fc45fb751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4def74a-de62-4359-a5a1-703bc6bd0903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4def74a-de62-4359-a5a1-703bc6bd0903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62e3862f-4cb2-4dac-a43f-6003fdae67e7', 'volume_name': 'volume-62e3862f-4cb2-4dac-a43f-6003fdae67e7', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1061186-1601-4a18-998f-d3b64545354e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1061186-1601-4a18-998f-d3b64545354e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76e46d5-9e87-4733-bca7-6955cc5d988c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:00 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Volume 62e3862f-4cb2-4dac-a43f-6003fdae67e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62e3862f-4cb2-4dac-a43f-6003fdae67e7', 'volume_size': 1} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1409290317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e3862f-4cb2-4dac-a43f-6003fdae67e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6f5b4c12f7422f91a7659cab1c4dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:01Z,use_quota=True,user_id='8e3a0c07a13442f0b5fefe5db0588993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Creating volume 62e3862f-4cb2-4dac-a43f-6003fdae67e7 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:33:00 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:33:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-62e3862f-4cb2-4dac-a43f-6003fdae67e7 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:00 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-62e3862f-4cb2-4dac-a43f-6003fdae67e7 1073741824 Apr 16 13:33:00 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:01 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-62e3862f-4cb2-4dac-a43f-6003fdae67e7 1073741824" returned: 0 in 0.553s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-62e3862f-4cb2-4dac-a43f-6003fdae67e7 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:01 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-62e3862f-4cb2-4dac-a43f-6003fdae67e7 Apr 16 13:33:01 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:01 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_k0hmgeh3devstack@QuobyteHD /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4" returned: 0 in 0.886s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:01 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_k0hmgeh3devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:33:01 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Converted 112.00 MB image at 112.00 MB/s Apr 16 13:33:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:01 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 1G Apr 16 13:33:01 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:01 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-62e3862f-4cb2-4dac-a43f-6003fdae67e7" returned: 0 in 0.499s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:33:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76e46d5-9e87-4733-bca7-6955cc5d988c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62e3862f-4cb2-4dac-a43f-6003fdae67e7', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37be1e4f-7d5b-43cd-beb0-6e9319bab25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:01 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Volume volume-62e3862f-4cb2-4dac-a43f-6003fdae67e7 (62e3862f-4cb2-4dac-a43f-6003fdae67e7): created successfully Apr 16 13:33:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37be1e4f-7d5b-43cd-beb0-6e9319bab25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Flow 'volume_create_manager' (7ff55c00-2562-4404-952b-df34e93a5f7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:01 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-69c63150-90c3-4953-a297-2462e2b8a7bf tempest-VolumesTransfersV357Test-961086802 None] Created volume successfully. Apr 16 13:33:01 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 1G" returned: 0 in 0.466s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:02 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3154bd34-a6b2-44ac-a2cd-2d914e0115df]: (4, 'raw') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:02 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 Apr 16 13:33:02 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:02 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4" returned: 0 in 0.486s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:02 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 Apr 16 13:33:02 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:03 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4" returned: 1 in 0.570s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4' failed. Not Retrying. {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 13:33:03 devstack cinder-volume[83606]: DEBUG cinder.volume.volume_utils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Downloaded image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}])) to volume 1d5fafb6-87f9-4dd1-acf1-111861b590b4 successfully. {{(pid=83606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 13:33:03 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Temporary image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 for user 2b6413239d344e129af56960ed8788ea is deleted. {{(pid=83606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 13:33:03 devstack cinder-volume[83606]: DEBUG cinder.volume.volume_utils [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Marking volume 1d5fafb6-87f9-4dd1-acf1-111861b590b4 as bootable. {{(pid=83606) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 13:33:03 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Copying metadata from image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 to 1d5fafb6-87f9-4dd1-acf1-111861b590b4. {{(pid=83606) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 13:33:03 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Creating volume glance metadata for volume 1d5fafb6-87f9-4dd1-acf1-111861b590b4 backed by image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83606) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 13:33:03 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-4d6b5e9f-086a-43e9-ad51-a6ae5a8638f2 tempest-VolumesTransfersV357Test-1370681788 None] Transfer volume completed successfully. Apr 16 13:33:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77dd4f80-c0e5-4cf3-a746-0ec858ad8068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4', 'volume_size': 1, 'image_id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4eb13d7d316f41debb8154b9017521da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'created_at': datetime.datetime(2026, 4, 16, 11, 21, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 11, 21, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e4e841-16e5-4c95-8902-8886395554db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:03 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Volume volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 (1d5fafb6-87f9-4dd1-acf1-111861b590b4): created successfully Apr 16 13:33:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e4e841-16e5-4c95-8902-8886395554db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Flow 'volume_create_manager' (744bfc62-db28-407b-8f3a-ac8561d224b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:03 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-9f4dffcc-6153-45c9-b119-3e61ee18814b tempest-VolumesGetTest-930736697 None] Created volume successfully. Apr 16 13:33:03 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] Acquiring lock "cinder-62e3862f-4cb2-4dac-a43f-6003fdae67e7-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:03 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] Lock "cinder-62e3862f-4cb2-4dac-a43f-6003fdae67e7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:03 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] Acquiring lock "cinder-quobyte-62e3862f-4cb2-4dac-a43f-6003fdae67e7" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:03 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] Lock "cinder-quobyte-62e3862f-4cb2-4dac-a43f-6003fdae67e7" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e33d58d-dd2d-4df7-9bea-aa849ae07186]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-62e3862f-4cb2-4dac-a43f-6003fdae67e7 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:04 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-62e3862f-4cb2-4dac-a43f-6003fdae67e7 Apr 16 13:33:04 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Flow 'volume_create_manager' (06c0389d-ef03-4cf5-8683-25ddded25431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c62e8ca-ef2e-4d7c-91ec-4e5bfb663a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c62e8ca-ef2e-4d7c-91ec-4e5bfb663a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-220947903',display_name='tempest-VolumesGetTest-Volume-195833610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa87e22-bcbb-4119-bd83-b2c08d9c015a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fce6494e4c04ee682d425d00a6a5115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:04Z,use_quota=True,user_id='2b6413239d344e129af56960ed8788ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f129ff98-29f1-40d5-971c-01a233bcc903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f129ff98-29f1-40d5-971c-01a233bcc903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a831ef84-3e83-49d4-9f63-4f920c4f2bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a831ef84-3e83-49d4-9f63-4f920c4f2bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa87e22-bcbb-4119-bd83-b2c08d9c015a', 'volume_name': 'volume-6fa87e22-bcbb-4119-bd83-b2c08d9c015a', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc8ababa-cdde-4faf-9e2e-7b9d0cd58a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc8ababa-cdde-4faf-9e2e-7b9d0cd58a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933a291b-b3c9-479a-81ac-a3b6f4b1b944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:04 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Volume 6fa87e22-bcbb-4119-bd83-b2c08d9c015a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa87e22-bcbb-4119-bd83-b2c08d9c015a', 'volume_size': 1} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-220947903',display_name='tempest-VolumesGetTest-Volume-195833610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa87e22-bcbb-4119-bd83-b2c08d9c015a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fce6494e4c04ee682d425d00a6a5115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:04Z,use_quota=True,user_id='2b6413239d344e129af56960ed8788ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Creating volume 6fa87e22-bcbb-4119-bd83-b2c08d9c015a {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:33:04 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6fa87e22-bcbb-4119-bd83-b2c08d9c015a 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:04 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6fa87e22-bcbb-4119-bd83-b2c08d9c015a 1073741824 Apr 16 13:33:04 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:04 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-62e3862f-4cb2-4dac-a43f-6003fdae67e7" returned: 0 in 0.577s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-62e3862f-4cb2-4dac-a43f-6003fdae67e7 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:04 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-62e3862f-4cb2-4dac-a43f-6003fdae67e7 Apr 16 13:33:04 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:05 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-62e3862f-4cb2-4dac-a43f-6003fdae67e7" returned: 0 in 0.414s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] Lock "cinder-quobyte-62e3862f-4cb2-4dac-a43f-6003fdae67e7" released by "delete_volume" :: held 1.033s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:05 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6fa87e22-bcbb-4119-bd83-b2c08d9c015a 1073741824" returned: 0 in 0.517s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] Created reservations ['0b10850c-08ee-47ee-9a5e-5205067dec34', 'f1f04e22-9858-4e0e-b1ca-cbd2c62dfb8f', 'b71d9989-c3c4-4f92-811c-75f2ec0f30e4', 'abf34bcc-fc15-4682-9bc7-e40c32a4d185'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6fa87e22-bcbb-4119-bd83-b2c08d9c015a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:05 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6fa87e22-bcbb-4119-bd83-b2c08d9c015a Apr 16 13:33:05 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:05 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:33:05 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:05 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6fa87e22-bcbb-4119-bd83-b2c08d9c015a" returned: 0 in 0.446s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933a291b-b3c9-479a-81ac-a3b6f4b1b944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa87e22-bcbb-4119-bd83-b2c08d9c015a', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60093f72-630c-4c91-80a0-96c7de56f59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:05 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Volume volume-6fa87e22-bcbb-4119-bd83-b2c08d9c015a (6fa87e22-bcbb-4119-bd83-b2c08d9c015a): created successfully Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60093f72-630c-4c91-80a0-96c7de56f59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Flow 'volume_create_manager' (06c0389d-ef03-4cf5-8683-25ddded25431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:05 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-7a1cf38a-6141-4164-8720-c3b3bc8c3cab tempest-VolumesGetTest-930736697 None] Created volume successfully. Apr 16 13:33:05 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.449s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:33:05 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] Deleted volume successfully. Apr 16 13:33:05 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3c9d9d0b-a5e9-4b74-9de8-3784e50eb8a2 tempest-VolumesTransfersV357Test-1145830670 None] Lock "cinder-62e3862f-4cb2-4dac-a43f-6003fdae67e7-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Flow 'volume_create_manager' (fb518a64-f4d8-4488-83de-3ee38b413d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc14de0-09ae-4437-b9de-be12f1827f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc14de0-09ae-4437-b9de-be12f1827f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1054845625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101f5213-e543-4d0c-b8c4-356942c9e007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6f5b4c12f7422f91a7659cab1c4dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:06Z,use_quota=True,user_id='8e3a0c07a13442f0b5fefe5db0588993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62807a85-5956-477b-aa81-5bad164c098b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62807a85-5956-477b-aa81-5bad164c098b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24470a0a-a5f9-4e74-b4a1-e7232febf5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24470a0a-a5f9-4e74-b4a1-e7232febf5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '101f5213-e543-4d0c-b8c4-356942c9e007', 'volume_name': 'volume-101f5213-e543-4d0c-b8c4-356942c9e007', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f54785-bdb2-4aa9-9dc7-9b846443b493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f54785-bdb2-4aa9-9dc7-9b846443b493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e444b939-458d-4355-8177-6e07fd4f6afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:06 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Volume 101f5213-e543-4d0c-b8c4-356942c9e007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-101f5213-e543-4d0c-b8c4-356942c9e007', 'volume_size': 1} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1054845625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101f5213-e543-4d0c-b8c4-356942c9e007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6f5b4c12f7422f91a7659cab1c4dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:06Z,use_quota=True,user_id='8e3a0c07a13442f0b5fefe5db0588993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Creating volume 101f5213-e543-4d0c-b8c4-356942c9e007 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:33:06 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-101f5213-e543-4d0c-b8c4-356942c9e007 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:06 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-101f5213-e543-4d0c-b8c4-356942c9e007 1073741824 Apr 16 13:33:06 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] Acquiring lock "cinder-6fa87e22-bcbb-4119-bd83-b2c08d9c015a-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] Lock "cinder-6fa87e22-bcbb-4119-bd83-b2c08d9c015a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] Acquiring lock "cinder-quobyte-6fa87e22-bcbb-4119-bd83-b2c08d9c015a" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-6fa87e22-bcbb-4119-bd83-b2c08d9c015a" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71227c6-d3eb-4520-ae60-3043d04fe4e5]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6fa87e22-bcbb-4119-bd83-b2c08d9c015a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:06 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6fa87e22-bcbb-4119-bd83-b2c08d9c015a Apr 16 13:33:06 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:07 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-101f5213-e543-4d0c-b8c4-356942c9e007 1073741824" returned: 0 in 0.552s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-101f5213-e543-4d0c-b8c4-356942c9e007 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:07 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-101f5213-e543-4d0c-b8c4-356942c9e007 Apr 16 13:33:07 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:07 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6fa87e22-bcbb-4119-bd83-b2c08d9c015a" returned: 0 in 0.492s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6fa87e22-bcbb-4119-bd83-b2c08d9c015a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:07 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6fa87e22-bcbb-4119-bd83-b2c08d9c015a Apr 16 13:33:07 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:07 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-101f5213-e543-4d0c-b8c4-356942c9e007" returned: 0 in 0.434s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e444b939-458d-4355-8177-6e07fd4f6afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-101f5213-e543-4d0c-b8c4-356942c9e007', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d39a95-0d87-4eeb-8ac4-a35bb447b9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:07 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Volume volume-101f5213-e543-4d0c-b8c4-356942c9e007 (101f5213-e543-4d0c-b8c4-356942c9e007): created successfully Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d39a95-0d87-4eeb-8ac4-a35bb447b9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Flow 'volume_create_manager' (fb518a64-f4d8-4488-83de-3ee38b413d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:07 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-1e193522-2857-48f8-b257-48529a52b402 tempest-VolumesTransfersV357Test-961086802 None] Created volume successfully. Apr 16 13:33:07 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6fa87e22-bcbb-4119-bd83-b2c08d9c015a" returned: 0 in 0.428s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-6fa87e22-bcbb-4119-bd83-b2c08d9c015a" released by "delete_volume" :: held 0.943s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] Created reservations ['6c04d6de-52c2-48da-9c8a-8c3e701fabb8', '085ded9d-b18e-4029-9f75-8837c052ecc8', '8cff23d0-c8e0-4caf-843f-01139b6bff6f', 'f3a40396-da18-4e3a-91ad-3f6cd118d2a7'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:07 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:33:07 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:08 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.431s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:08 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:33:08 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] Deleted volume successfully. Apr 16 13:33:08 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:SELECT=117,cinder:INSERT=41,cinder:UPDATE=157,cinder:DELETE=12 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:33:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9407b011-b95c-4ece-8c6e-fa02b13ad462 tempest-VolumesGetTest-930736697 None] Lock "cinder-6fa87e22-bcbb-4119-bd83-b2c08d9c015a-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] Acquiring lock "cinder-101f5213-e543-4d0c-b8c4-356942c9e007-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] Lock "cinder-101f5213-e543-4d0c-b8c4-356942c9e007-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] Acquiring lock "cinder-quobyte-101f5213-e543-4d0c-b8c4-356942c9e007" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] Lock "cinder-quobyte-101f5213-e543-4d0c-b8c4-356942c9e007" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:08 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e5995a-ce6a-4dce-913d-47f36cead82e]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-101f5213-e543-4d0c-b8c4-356942c9e007 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:08 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-101f5213-e543-4d0c-b8c4-356942c9e007 Apr 16 13:33:08 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Acquiring lock "cinder-1d5fafb6-87f9-4dd1-acf1-111861b590b4-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Lock "cinder-1d5fafb6-87f9-4dd1-acf1-111861b590b4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Acquiring lock "cinder-quobyte-1d5fafb6-87f9-4dd1-acf1-111861b590b4" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-1d5fafb6-87f9-4dd1-acf1-111861b590b4" acquired by "delete_volume" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdcc662-097d-4372-b062-7a5357ee731f]: (4, 'raw') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:09 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 Apr 16 13:33:09 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:09 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-101f5213-e543-4d0c-b8c4-356942c9e007" returned: 0 in 0.549s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-101f5213-e543-4d0c-b8c4-356942c9e007 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:09 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-101f5213-e543-4d0c-b8c4-356942c9e007 Apr 16 13:33:09 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:09 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4" returned: 0 in 0.451s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:09 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 Apr 16 13:33:09 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:09 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-101f5213-e543-4d0c-b8c4-356942c9e007" returned: 0 in 0.444s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] Lock "cinder-quobyte-101f5213-e543-4d0c-b8c4-356942c9e007" released by "delete_volume" :: held 1.016s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] Created reservations ['7700403e-3bb1-44cd-9cb2-7822e0b7dc03', '51f97424-86a8-4eb2-bd44-f03530bd1f3a', '339ca33b-243e-48ef-9eac-f53fe7a881d8', '5f9d2188-859d-4aeb-8b00-4d38157ae2a7'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:09 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:33:09 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:09 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4" returned: 1 in 0.494s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4' failed. Not Retrying. {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 13:33:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:09 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4 Apr 16 13:33:09 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:10 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.446s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:10 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:33:10 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] Deleted volume successfully. Apr 16 13:33:10 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4848c1cb-9597-4297-99e7-c3972389d9e8 tempest-VolumesTransfersV357Test-1145830670 None] Lock "cinder-101f5213-e543-4d0c-b8c4-356942c9e007-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:10 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-1d5fafb6-87f9-4dd1-acf1-111861b590b4" returned: 0 in 0.427s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:10 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Lock "cinder-quobyte-1d5fafb6-87f9-4dd1-acf1-111861b590b4" released by "delete_volume" :: held 1.409s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:10 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Created reservations ['2d8a5525-c58d-4e9b-b355-f0a0adee7f32', '1e81bf78-42c5-46f0-96d7-cff23de640cb', '22533e89-c923-40ca-8340-3b1d1b2b79bc', '4ee9a2e5-1edc-4e06-becc-e2724d40d834'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:33:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:10 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:33:10 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:10 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.404s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:10 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:33:10 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Deleted volume successfully. Apr 16 13:33:10 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9759a9ea-3974-4f0d-9468-0a6b1a3ca75c tempest-VolumesGetTest-930736697 None] Lock "cinder-1d5fafb6-87f9-4dd1-acf1-111861b590b4-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:14 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:33:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Flow 'volume_create_manager' (06b41fb4-1b87-412c-af95-9ec76edf7a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78543a66-734c-4f10-aa31-722b8b30f191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78543a66-734c-4f10-aa31-722b8b30f191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1925365435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08b61a7-95a7-45de-b0b1-9184a56add55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e6e9cd90cc4aaaa2065d84ce4863d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:14Z,use_quota=True,user_id='93f5515088ef4a7b93ff3411d4518ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d730a9-7f18-4ca3-8e54-e75001d6f8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d730a9-7f18-4ca3-8e54-e75001d6f8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8928b7-b31a-4f8f-939a-9d6418fc656e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:14 devstack cinder-volume[83606]: DEBUG cinder.image.glance [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Creating Keystone auth plugin from conf {{(pid=83606) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 13:33:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8928b7-b31a-4f8f-939a-9d6418fc656e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c08b61a7-95a7-45de-b0b1-9184a56add55', 'volume_name': 'volume-c08b61a7-95a7-45de-b0b1-9184a56add55', 'volume_size': 1, 'image_id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4eb13d7d316f41debb8154b9017521da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'created_at': datetime.datetime(2026, 4, 16, 11, 21, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 11, 21, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6705690d-b5b6-48cb-84a4-bb17d81676a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6705690d-b5b6-48cb-84a4-bb17d81676a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:14 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18d3091-41bc-4c77-b19a-e6af88372973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:14 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Volume c08b61a7-95a7-45de-b0b1-9184a56add55: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c08b61a7-95a7-45de-b0b1-9184a56add55', 'volume_size': 1, 'image_id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4eb13d7d316f41debb8154b9017521da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'created_at': datetime.datetime(2026, 4, 16, 11, 21, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 11, 21, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 13:33:14 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Trying to clone c08b61a7-95a7-45de-b0b1-9184a56add55 from image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}]). {{(pid=83606) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 13:33:14 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_ckvf5tnrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83606) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 13:33:14 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Image download 20.69 MB at 20.69 MB/s Apr 16 13:33:14 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[31eb08c9-f9c6-4262-bc41-a180c9f216bc]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_ckvf5tnrdevstack@QuobyteHD {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:15 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_ckvf5tnrdevstack@QuobyteHD Apr 16 13:33:15 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:15 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_ckvf5tnrdevstack@QuobyteHD" returned: 0 in 0.525s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:15 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Temporary image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 is fetched for user 93f5515088ef4a7b93ff3411d4518ba1. {{(pid=83606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 13:33:15 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24ac69e-8321-4338-b0c4-8a6ce023829b]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_ckvf5tnrdevstack@QuobyteHD {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:15 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_ckvf5tnrdevstack@QuobyteHD Apr 16 13:33:15 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:16 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_ckvf5tnrdevstack@QuobyteHD" returned: 0 in 0.624s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:16 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1925365435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08b61a7-95a7-45de-b0b1-9184a56add55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e6e9cd90cc4aaaa2065d84ce4863d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:14Z,use_quota=True,user_id='93f5515088ef4a7b93ff3411d4518ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:33:16 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Creating volume c08b61a7-95a7-45de-b0b1-9184a56add55 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:33:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:16 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:16 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:16 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:33:16 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:33:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:16 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 1073741824 Apr 16 13:33:16 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:16 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 1073741824" returned: 0 in 0.489s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:16 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 Apr 16 13:33:16 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:17 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55" returned: 0 in 0.442s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:33:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:17 devstack cinder-volume[83606]: DEBUG cinder.volume.volume_utils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Attempting download of 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}])) to volume c08b61a7-95a7-45de-b0b1-9184a56add55. {{(pid=83606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 13:33:17 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[822b21f8-e127-41e0-b1b2-ba70ecf6ab2f]: (4, 'raw') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_9spupo_h {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:17 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_9spupo_h Apr 16 13:33:17 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:17 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_9spupo_h" returned: 0 in 0.528s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_9spupo_h {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:17 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_9spupo_h Apr 16 13:33:17 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:18 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_9spupo_h" returned: 1 in 0.509s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_9spupo_h' failed. Not Retrying. {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 13:33:18 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a03d432-eeb3-455b-9128-a20466f67bd8]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_ckvf5tnrdevstack@QuobyteHD {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:18 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_ckvf5tnrdevstack@QuobyteHD Apr 16 13:33:18 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:18 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_ckvf5tnrdevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:18 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 was qcow2, converting to raw {{(pid=83606) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 13:33:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_ckvf5tnrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:18 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_ckvf5tnrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 Apr 16 13:33:18 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:19 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_ckvf5tnrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55" returned: 0 in 0.921s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:19 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6_ckvf5tnrdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:33:19 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Converted 112.00 MB image at 112.00 MB/s Apr 16 13:33:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:19 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 1G Apr 16 13:33:19 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:20 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 1G" returned: 0 in 0.517s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5bfded-1c23-426d-9ed5-2e95bb6fbe1a]: (4, 'raw') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:20 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 Apr 16 13:33:20 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Flow 'volume_create_manager' (b7c4ca75-abeb-4752-9450-5cb11efbd9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f177940-1031-42d9-a919-982fb3e59291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f177940-1031-42d9-a919-982fb3e59291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1764630567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313edf4f-fa2a-455e-a10e-f8a68a29e42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d9f5a09b945e9a9cc5dcad09bc789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:20Z,use_quota=True,user_id='cf82ff471fa4471c9740038f919bf3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5b9598-8e2a-4138-a41b-a6c3996eb82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5b9598-8e2a-4138-a41b-a6c3996eb82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12523d7-48a0-4799-ad39-a05eb1c388e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12523d7-48a0-4799-ad39-a05eb1c388e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '313edf4f-fa2a-455e-a10e-f8a68a29e42c', 'volume_name': 'volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c70b31-6a2b-44bd-9be4-612dc9d28ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c70b31-6a2b-44bd-9be4-612dc9d28ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92b185e-3458-4130-a6d6-7d5428401fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:20 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Volume 313edf4f-fa2a-455e-a10e-f8a68a29e42c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c', 'volume_size': 1} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1764630567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313edf4f-fa2a-455e-a10e-f8a68a29e42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d9f5a09b945e9a9cc5dcad09bc789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:20Z,use_quota=True,user_id='cf82ff471fa4471c9740038f919bf3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Creating volume 313edf4f-fa2a-455e-a10e-f8a68a29e42c {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:33:20 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:20 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c 1073741824 Apr 16 13:33:20 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:20 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55" returned: 0 in 0.485s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:20 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 Apr 16 13:33:20 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:20 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c 1073741824" returned: 0 in 0.487s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:UPDATE=139,cinder:SELECT=112,cinder:INSERT=53,cinder:DELETE=11 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:33:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:20 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c Apr 16 13:33:20 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:21 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55" returned: 1 in 0.485s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55' failed. Not Retrying. {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG cinder.volume.volume_utils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Downloaded image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}])) to volume c08b61a7-95a7-45de-b0b1-9184a56add55 successfully. {{(pid=83606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Temporary image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 for user 93f5515088ef4a7b93ff3411d4518ba1 is deleted. {{(pid=83606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG cinder.volume.volume_utils [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Marking volume c08b61a7-95a7-45de-b0b1-9184a56add55 as bootable. {{(pid=83606) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Copying metadata from image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 to c08b61a7-95a7-45de-b0b1-9184a56add55. {{(pid=83606) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Creating volume glance metadata for volume c08b61a7-95a7-45de-b0b1-9184a56add55 backed by image 7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83606) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18d3091-41bc-4c77-b19a-e6af88372973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c08b61a7-95a7-45de-b0b1-9184a56add55', 'volume_size': 1, 'image_id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4eb13d7d316f41debb8154b9017521da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6', 'created_at': datetime.datetime(2026, 4, 16, 11, 21, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 11, 21, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f4bf39e-dbf1-4cc9-b5bc-3bbd2df2fbf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf10d4c3-c4bf-4f4f-a97a-6d821246246a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:21 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Volume volume-c08b61a7-95a7-45de-b0b1-9184a56add55 (c08b61a7-95a7-45de-b0b1-9184a56add55): created successfully Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf10d4c3-c4bf-4f4f-a97a-6d821246246a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Flow 'volume_create_manager' (06b41fb4-1b87-412c-af95-9ec76edf7a5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:21 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-ae05660f-8e16-4d7d-a70a-2f86aec1f7d5 tempest-VolumesExtendTest-789767384 None] Created volume successfully. Apr 16 13:33:21 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c" returned: 0 in 0.422s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92b185e-3458-4130-a6d6-7d5428401fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9e3efe-005e-45b4-992f-4a313688b777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:21 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Volume volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c (313edf4f-fa2a-455e-a10e-f8a68a29e42c): created successfully Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9e3efe-005e-45b4-992f-4a313688b777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Flow 'volume_create_manager' (b7c4ca75-abeb-4752-9450-5cb11efbd9f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:21 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-767147fd-8315-421f-8e12-adec368fd713 tempest-VolumesSnapshotTestJSON-999810695 None] Created volume successfully. Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c31d6ff4-5667-476b-9112-7c3009794e9b tempest-VolumesExtendTest-789767384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c31d6ff4-5667-476b-9112-7c3009794e9b tempest-VolumesExtendTest-789767384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3682b81a-08c6-46d1-bbb0-6b4b3036abf2]: (4, 'raw') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c31d6ff4-5667-476b-9112-7c3009794e9b tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:22 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 Apr 16 13:33:22 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:22 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c31d6ff4-5667-476b-9112-7c3009794e9b tempest-VolumesExtendTest-789767384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55" returned: 0 in 0.465s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c31d6ff4-5667-476b-9112-7c3009794e9b tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:22 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 Apr 16 13:33:22 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:22 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c31d6ff4-5667-476b-9112-7c3009794e9b tempest-VolumesExtendTest-789767384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55" returned: 1 in 0.485s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c31d6ff4-5667-476b-9112-7c3009794e9b tempest-VolumesExtendTest-789767384 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55' failed. Not Retrying. {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 13:33:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c31d6ff4-5667-476b-9112-7c3009794e9b tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 2G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c31d6ff4-5667-476b-9112-7c3009794e9b tempest-VolumesExtendTest-789767384 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 2G" returned: 0 in 0.036s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c31d6ff4-5667-476b-9112-7c3009794e9b tempest-VolumesExtendTest-789767384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.016s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.347s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:23 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] Creating offline snapshot aff32866-db86-4ace-aa47-ae3aa1b238bc of volume 313edf4f-fa2a-455e-a10e-f8a68a29e42c {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:33:23 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-c31d6ff4-5667-476b-9112-7c3009794e9b tempest-VolumesExtendTest-789767384 None] Extend volume completed successfully. Apr 16 13:33:23 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a211c65-f3c5-4891-8b2b-fd1b762efc50]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:23 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c Apr 16 13:33:23 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:23 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c" returned: 0 in 0.470s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:23 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc 1G Apr 16 13:33:23 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:23 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc 1G" returned: 0 in 0.486s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:24 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc Apr 16 13:33:24 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Acquiring lock "cinder-c08b61a7-95a7-45de-b0b1-9184a56add55-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Lock "cinder-c08b61a7-95a7-45de-b0b1-9184a56add55-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Acquiring lock "cinder-quobyte-c08b61a7-95a7-45de-b0b1-9184a56add55" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Lock "cinder-quobyte-c08b61a7-95a7-45de-b0b1-9184a56add55" acquired by "delete_volume" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:24 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d79f2c-ff22-4b47-9570-5189abd0506f]: (4, 'raw') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:24 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 Apr 16 13:33:24 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:24 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc" returned: 0 in 0.448s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:24 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc is being set with open permissions: ugo+rw Apr 16 13:33:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:24 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc Apr 16 13:33:24 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:24 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55" returned: 0 in 0.447s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:24 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 Apr 16 13:33:24 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:24 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc" returned: 0 in 0.439s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:24 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.info Apr 16 13:33:24 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:25 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55" returned: 1 in 0.466s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55' failed. Not Retrying. {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 13:33:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:25 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55 Apr 16 13:33:25 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:25 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.info" returned: 0 in 0.447s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:25 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.info is being set with open permissions: ugo+rw Apr 16 13:33:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:25 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.info Apr 16 13:33:25 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:25 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c08b61a7-95a7-45de-b0b1-9184a56add55" returned: 0 in 0.459s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:25 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Lock "cinder-quobyte-c08b61a7-95a7-45de-b0b1-9184a56add55" released by "delete_volume" :: held 1.412s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:25 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Created reservations ['990676ae-182a-4412-b13c-5ced51dd4982', 'a76887e0-c4ad-4d08-913b-f6d92ee88334', '6040499e-cd48-410d-a75e-ac615604f7bc', '541d3935-e6dd-461d-b472-e93b1736df2f'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:33:25 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:25 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:25 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.info" returned: 0 in 0.431s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.788s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:25 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:33:25 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:25 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-2e7587df-2a6c-4064-b363-439d4d93d077 tempest-VolumesSnapshotTestJSON-999810695 None] Create snapshot completed successfully Apr 16 13:33:26 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.434s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:33:26 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Deleted volume successfully. Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a7e79ae-3b3a-48f8-9fba-73ee91176a96 tempest-VolumesExtendTest-789767384 None] Lock "cinder-c08b61a7-95a7-45de-b0b1-9184a56add55-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Flow 'volume_create_manager' (84e4537b-9f90-41df-8faa-f887efac4d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91e5e9a-391d-43c4-9010-48b3756d70b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91e5e9a-391d-43c4-9010-48b3756d70b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-564059270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e7118f-b0d0-44a3-8a12-9a7a5f24da87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e6e9cd90cc4aaaa2065d84ce4863d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:27Z,use_quota=True,user_id='93f5515088ef4a7b93ff3411d4518ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41f7c2d-66c0-4ad0-a67b-6fdd63106a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41f7c2d-66c0-4ad0-a67b-6fdd63106a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1571ed-bcab-48ad-b7f9-b839fe46e725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1571ed-bcab-48ad-b7f9-b839fe46e725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53e7118f-b0d0-44a3-8a12-9a7a5f24da87', 'volume_name': 'volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a340f9-ad31-43b4-8732-289edbf69edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a340f9-ad31-43b4-8732-289edbf69edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d5a01c-4bee-4444-b4d6-e83dbe9bea08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:26 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Volume 53e7118f-b0d0-44a3-8a12-9a7a5f24da87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87', 'volume_size': 1} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-564059270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e7118f-b0d0-44a3-8a12-9a7a5f24da87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e6e9cd90cc4aaaa2065d84ce4863d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:27Z,use_quota=True,user_id='93f5515088ef4a7b93ff3411d4518ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Creating volume 53e7118f-b0d0-44a3-8a12-9a7a5f24da87 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:33:26 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:26 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 1073741824 Apr 16 13:33:26 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-aff32866-db86-4ace-aa47-ae3aa1b238bc-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-aff32866-db86-4ace-aa47-ae3aa1b238bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-quobyte-313edf4f-fa2a-455e-a10e-f8a68a29e42c" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-313edf4f-fa2a-455e-a10e-f8a68a29e42c" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-quobyte-aff32866-db86-4ace-aa47-ae3aa1b238bc" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-aff32866-db86-4ace-aa47-ae3aa1b238bc" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] Deleting offline snapshot aff32866-db86-4ace-aa47-ae3aa1b238bc of volume 313edf4f-fa2a-455e-a10e-f8a68a29e42c {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] snapshot_file for this snap is: volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff82d49-700f-43d0-bdbf-639644234120]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:27 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc Apr 16 13:33:27 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:27 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 1073741824" returned: 0 in 0.509s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:27 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 Apr 16 13:33:27 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:27 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc" returned: 0 in 0.495s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:33:27 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e88b54-64f9-4155-8bd7-5c07f6652c1f]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:27 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c Apr 16 13:33:27 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:27 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87" returned: 0 in 0.443s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:33:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d5a01c-4bee-4444-b4d6-e83dbe9bea08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f7b06f-3046-4176-a9f0-af3a2ec5618b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:27 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Volume volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 (53e7118f-b0d0-44a3-8a12-9a7a5f24da87): created successfully Apr 16 13:33:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f7b06f-3046-4176-a9f0-af3a2ec5618b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:27 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Flow 'volume_create_manager' (84e4537b-9f90-41df-8faa-f887efac4d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:27 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-0876b48a-9b4a-46e4-addd-c771b1e30fa7 tempest-VolumesExtendTest-789767384 None] Created volume successfully. Apr 16 13:33:28 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c" returned: 0 in 0.514s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:28 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc Apr 16 13:33:28 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:28 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc" returned: 0 in 0.449s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:28 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc Apr 16 13:33:28 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:28 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c.aff32866-db86-4ace-aa47-ae3aa1b238bc" returned: 0 in 0.442s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] Creating offline snapshot e6ac757a-a076-4dab-b4a5-5751695ba8c3 of volume 53e7118f-b0d0-44a3-8a12-9a7a5f24da87 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:33:28 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6652194-7125-4e41-a99d-b6ab9ac907e0]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-aff32866-db86-4ace-aa47-ae3aa1b238bc" released by "_delete_snapshot" :: held 1.973s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-313edf4f-fa2a-455e-a10e-f8a68a29e42c" released by "delete_snapshot" :: held 1.984s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:28 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 Apr 16 13:33:28 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:28 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] Created reservations ['b8f5b4c0-6e1f-4cae-8b6a-d45dd402aaa7', '9da48f8b-621b-43b2-92e8-1f28e05db8a2', '52b785a0-bfe2-496c-96d8-f36a1744d81e', '89293b0c-1401-46ed-8c91-4f9b13250873'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:33:29 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] Delete snapshot completed successfully. Apr 16 13:33:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fd380558-e0c6-4437-9ec5-9392d7c42778 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-aff32866-db86-4ace-aa47-ae3aa1b238bc-delete_snapshot" released by "delete_snapshot" :: held 2.094s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:29 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87" returned: 0 in 0.477s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:29 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3 1G Apr 16 13:33:29 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:29 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3 1G" returned: 0 in 0.452s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:29 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3 Apr 16 13:33:29 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:30 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3" returned: 0 in 0.496s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:30 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3 is being set with open permissions: ugo+rw Apr 16 13:33:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:30 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3 Apr 16 13:33:30 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:30 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:33:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Flow 'volume_create_manager' (db4b0acf-831e-460a-8663-449d2d1b5e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e9f484-935f-40ff-9aa5-4f9a7c9954d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e9f484-935f-40ff-9aa5-4f9a7c9954d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1660510596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5030e9d2-d53b-4b20-9eef-75c2d8925a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d9f5a09b945e9a9cc5dcad09bc789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:30Z,use_quota=True,user_id='cf82ff471fa4471c9740038f919bf3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95de3853-4a03-456e-ba6e-03751a099695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95de3853-4a03-456e-ba6e-03751a099695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f933fed-af5e-4f50-9e87-cec6b7fdda69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f933fed-af5e-4f50-9e87-cec6b7fdda69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5030e9d2-d53b-4b20-9eef-75c2d8925a03', 'volume_name': 'volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a75c127-a38a-4018-a1a4-e66ffe2ecdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a75c127-a38a-4018-a1a4-e66ffe2ecdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298f06a8-cbf1-453f-b825-60d9c3d810d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:30 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Volume 5030e9d2-d53b-4b20-9eef-75c2d8925a03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03', 'volume_size': 1} Apr 16 13:33:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:30 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3" returned: 0 in 0.404s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:30 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.info Apr 16 13:33:30 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:31 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.info" returned: 0 in 0.454s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:31 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.info is being set with open permissions: ugo+rw Apr 16 13:33:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:31 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.info Apr 16 13:33:31 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:31 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.info" returned: 0 in 0.405s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.746s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.196s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:31 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1660510596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5030e9d2-d53b-4b20-9eef-75c2d8925a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d9f5a09b945e9a9cc5dcad09bc789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:30Z,use_quota=True,user_id='cf82ff471fa4471c9740038f919bf3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:33:31 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Creating volume 5030e9d2-d53b-4b20-9eef-75c2d8925a03 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:33:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:31 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:31 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:31 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:33:31 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:33:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:31 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 1073741824 Apr 16 13:33:31 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:31 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-b68b7447-3954-4af6-8107-de8461b1afd6 tempest-VolumesExtendTest-789767384 None] Create snapshot completed successfully Apr 16 13:33:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4dd07615-e32e-4cfa-b236-9a3a52f3b56d tempest-VolumesExtendTest-789767384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:32 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 1073741824" returned: 0 in 0.492s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:32 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 Apr 16 13:33:32 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:32 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03" returned: 0 in 0.437s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:32 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:33:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4dd07615-e32e-4cfa-b236-9a3a52f3b56d tempest-VolumesExtendTest-789767384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.496s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298f06a8-cbf1-453f-b825-60d9c3d810d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d71e81-64c2-4c3b-a270-4c51beacf984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:32 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ac0547-ea32-458a-bd95-b45a4d56978f]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4dd07615-e32e-4cfa-b236-9a3a52f3b56d tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:32 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Volume volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 (5030e9d2-d53b-4b20-9eef-75c2d8925a03): created successfully Apr 16 13:33:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d71e81-64c2-4c3b-a270-4c51beacf984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Flow 'volume_create_manager' (db4b0acf-831e-460a-8663-449d2d1b5e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:32 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-8de44ee6-8547-497c-b883-adcb4f5a2700 tempest-VolumesSnapshotTestJSON-999810695 None] Created volume successfully. Apr 16 13:33:32 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 Apr 16 13:33:32 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:33 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4dd07615-e32e-4cfa-b236-9a3a52f3b56d tempest-VolumesExtendTest-789767384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87" returned: 0 in 0.484s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4dd07615-e32e-4cfa-b236-9a3a52f3b56d tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3 2G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4dd07615-e32e-4cfa-b236-9a3a52f3b56d tempest-VolumesExtendTest-789767384 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3 2G" returned: 0 in 0.096s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4dd07615-e32e-4cfa-b236-9a3a52f3b56d tempest-VolumesExtendTest-789767384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.609s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:33 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-4dd07615-e32e-4cfa-b236-9a3a52f3b56d tempest-VolumesExtendTest-789767384 None] Extend volume completed successfully. Apr 16 13:33:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:33 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] Creating offline snapshot 39c9c475-b2a2-4121-83f5-797ee520f89c of volume 5030e9d2-d53b-4b20-9eef-75c2d8925a03 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:33:33 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0ebd35-e690-4b44-bbe7-d25d044070ed]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:33 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 Apr 16 13:33:33 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:34 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03" returned: 0 in 0.497s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:34 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c 1G Apr 16 13:33:34 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] Acquiring lock "cinder-e6ac757a-a076-4dab-b4a5-5751695ba8c3-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] Lock "cinder-e6ac757a-a076-4dab-b4a5-5751695ba8c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] Acquiring lock "cinder-quobyte-53e7118f-b0d0-44a3-8a12-9a7a5f24da87" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] Lock "cinder-quobyte-53e7118f-b0d0-44a3-8a12-9a7a5f24da87" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] Acquiring lock "cinder-quobyte-e6ac757a-a076-4dab-b4a5-5751695ba8c3" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] Lock "cinder-quobyte-e6ac757a-a076-4dab-b4a5-5751695ba8c3" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] Deleting offline snapshot e6ac757a-a076-4dab-b4a5-5751695ba8c3 of volume 53e7118f-b0d0-44a3-8a12-9a7a5f24da87 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] snapshot_file for this snap is: volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ad1ab8-b279-4b79-9e5e-5fe1f8c23244]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:34 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3 Apr 16 13:33:34 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:34 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c 1G" returned: 0 in 0.498s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:34 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c Apr 16 13:33:34 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:34 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3" returned: 0 in 0.499s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc7388a-c396-4efd-9129-4bd03974624f]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:34 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 Apr 16 13:33:34 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:35 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c" returned: 0 in 0.455s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:35 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c is being set with open permissions: ugo+rw Apr 16 13:33:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:35 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c Apr 16 13:33:35 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:35 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87" returned: 0 in 0.472s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:35 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3 Apr 16 13:33:35 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:35 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c" returned: 0 in 0.420s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:35 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.info Apr 16 13:33:35 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:35 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3" returned: 0 in 0.488s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:35 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3 Apr 16 13:33:35 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:35 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.info" returned: 0 in 0.442s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:35 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.info is being set with open permissions: ugo+rw Apr 16 13:33:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:35 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.info Apr 16 13:33:35 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:36 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87.e6ac757a-a076-4dab-b4a5-5751695ba8c3" returned: 0 in 0.420s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:36 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] Lock "cinder-quobyte-e6ac757a-a076-4dab-b4a5-5751695ba8c3" released by "_delete_snapshot" :: held 1.935s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:36 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] Lock "cinder-quobyte-53e7118f-b0d0-44a3-8a12-9a7a5f24da87" released by "delete_snapshot" :: held 1.946s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:36 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] Created reservations ['d0ccb98c-e425-42f3-b141-27900d6ddf14', 'b58bb0c7-cfbb-4d41-8e36-445ecfbc2a1d', 'a58deb50-a962-4454-8f62-92e2b857ad2a', 'f996279f-68a0-4301-9fda-613c4338f01d'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:33:36 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] Delete snapshot completed successfully. Apr 16 13:33:36 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-f3ebce01-c2e2-4db3-b1e3-a531ddb573e0 tempest-VolumesExtendTest-789767384 None] Lock "cinder-e6ac757a-a076-4dab-b4a5-5751695ba8c3-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:36 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.info" returned: 0 in 0.423s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.787s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:36 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-83b1b3a5-7eba-4dbf-ae20-3cb8beea56b9 tempest-VolumesSnapshotTestJSON-999810695 None] Create snapshot completed successfully Apr 16 13:33:36 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] Acquiring lock "cinder-53e7118f-b0d0-44a3-8a12-9a7a5f24da87-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:36 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] Lock "cinder-53e7118f-b0d0-44a3-8a12-9a7a5f24da87-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:36 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] Acquiring lock "cinder-quobyte-53e7118f-b0d0-44a3-8a12-9a7a5f24da87" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:36 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] Lock "cinder-quobyte-53e7118f-b0d0-44a3-8a12-9a7a5f24da87" acquired by "delete_volume" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:36 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8b10e3-eb3e-40c6-9320-14c06ca36670]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:36 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 Apr 16 13:33:36 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Flow 'volume_create_manager' (1b546879-ea5c-445f-9d27-7064f87d0332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b724ae-2bb8-4921-8130-82d50543e89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b724ae-2bb8-4921-8130-82d50543e89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1926514735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8f1496-0937-4a94-8c2f-b66c5c7232e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d9f5a09b945e9a9cc5dcad09bc789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=39c9c475-b2a2-4121-83f5-797ee520f89c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:37Z,use_quota=True,user_id='cf82ff471fa4471c9740038f919bf3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fb224c-57b0-4c28-9f03-26f1003f7102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fb224c-57b0-4c28-9f03-26f1003f7102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b33805d-78ec-4643-8fd5-c11c9680fd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b33805d-78ec-4643-8fd5-c11c9680fd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ba8f1496-0937-4a94-8c2f-b66c5c7232e9', 'volume_name': 'volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9', 'volume_size': 2, 'snapshot_id': '39c9c475-b2a2-4121-83f5-797ee520f89c'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506330ad-2d4a-4482-a88e-9002e115f408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506330ad-2d4a-4482-a88e-9002e115f408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecc6e11-6a03-41f3-aea5-11c69faace90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:37 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Volume ba8f1496-0937-4a94-8c2f-b66c5c7232e9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9', 'volume_size': 2, 'snapshot_id': '39c9c475-b2a2-4121-83f5-797ee520f89c'} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-quobyte-39c9c475-b2a2-4121-83f5-797ee520f89c-ba8f1496-0937-4a94-8c2f-b66c5c7232e9" by "_create_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-39c9c475-b2a2-4121-83f5-797ee520f89c-ba8f1496-0937-4a94-8c2f-b66c5c7232e9" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Creating volume ba8f1496-0937-4a94-8c2f-b66c5c7232e9 from snapshot 39c9c475-b2a2-4121-83f5-797ee520f89c {{(pid=83606) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:37 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-quobyte-ba8f1496-0937-4a94-8c2f-b66c5c7232e9" by "_copy_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87" returned: 0 in 0.523s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-ba8f1496-0937-4a94-8c2f-b66c5c7232e9" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] snapshot: 39c9c475-b2a2-4121-83f5-797ee520f89c, volume: ba8f1496-0937-4a94-8c2f-b66c5c7232e9, {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 13:33:37 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87 Apr 16 13:33:37 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eedab29-040c-4644-aed7-2630e292aa65]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:37 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c Apr 16 13:33:37 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:37 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-53e7118f-b0d0-44a3-8a12-9a7a5f24da87" returned: 0 in 0.410s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] Lock "cinder-quobyte-53e7118f-b0d0-44a3-8a12-9a7a5f24da87" released by "delete_volume" :: held 0.969s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] Created reservations ['2b946a80-58f9-44aa-8cc3-5526099b2a37', 'c29207db-8491-4bc3-ad28-1416fc942d18', 'dceabc96-042f-4618-b948-49e828f32b81', 'ee48d8d6-f06d-4c75-8ffe-3e22f616cf00'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:37 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:33:37 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:37 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c" returned: 0 in 0.513s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Creating direct copy from snapshot {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddae26cf-7656-4a57-90f0-8c05a004b11c]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:37 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 Apr 16 13:33:37 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:38 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.512s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:38 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:33:38 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] Deleted volume successfully. Apr 16 13:33:38 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-862b5fb9-3254-4aad-bb26-44f9e27e0b1f tempest-VolumesExtendTest-789767384 None] Lock "cinder-53e7118f-b0d0-44a3-8a12-9a7a5f24da87-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:38 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03" returned: 0 in 0.586s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:38 devstack cinder-volume[83606]: DEBUG cinder.utils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Path /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9 not found in is_blk_device check {{(pid=83606) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 13:33:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:38 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9 Apr 16 13:33:38 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:40 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9" returned: 0 in 2.167s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:40 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcc72db-5160-44d7-83af-ba7db6700eab]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:40 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 Apr 16 13:33:40 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:41 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03" returned: 0 in 0.665s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:41 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Image conversion details: src /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9 {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:33:41 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Converted 1024.00 MB image at 472.36 MB/s Apr 16 13:33:41 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9 is being set with open permissions: ugo+rw Apr 16 13:33:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:41 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9 Apr 16 13:33:41 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:41 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9" returned: 0 in 0.477s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:41 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-ba8f1496-0937-4a94-8c2f-b66c5c7232e9" released by "_copy_volume_from_snapshot" :: held 4.470s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:41 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-39c9c475-b2a2-4121-83f5-797ee520f89c-ba8f1496-0937-4a94-8c2f-b66c5c7232e9" released by "_create_volume_from_snapshot" :: held 4.497s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.504s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecc6e11-6a03-41f3-aea5-11c69faace90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9', 'volume_size': 2, 'snapshot_id': '39c9c475-b2a2-4121-83f5-797ee520f89c'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da94a8d-9710-4831-af55-7b502fb99425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:41 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Volume volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9 (ba8f1496-0937-4a94-8c2f-b66c5c7232e9): created successfully Apr 16 13:33:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da94a8d-9710-4831-af55-7b502fb99425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Flow 'volume_create_manager' (1b546879-ea5c-445f-9d27-7064f87d0332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:41 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-1d4a8b0b-bde7-4abd-a826-57da58f18cb3 tempest-VolumesSnapshotTestJSON-999810695 None] Created volume successfully. Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Flow 'volume_create_manager' (20c8800f-235b-4b6e-bd1a-d0c3a354f95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc62d7d-e695-4b9d-a38a-01adb941a1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc62d7d-e695-4b9d-a38a-01adb941a1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-525584495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9753718d-fa4e-4005-ad75-dbe858b6afc7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='143cbaaed41c42789e901ed82c650d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:42Z,use_quota=True,user_id='5f8a5176a15244898082f4378fef43bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d322d47c-5506-4478-a1b9-cba09df87641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d322d47c-5506-4478-a1b9-cba09df87641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ea3cc3-1a84-4f99-9e85-6ebd6c1951a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ea3cc3-1a84-4f99-9e85-6ebd6c1951a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9753718d-fa4e-4005-ad75-dbe858b6afc7', 'volume_name': 'volume-9753718d-fa4e-4005-ad75-dbe858b6afc7', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c5bf20-d59f-4b5e-b935-ddfdfb77f504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c5bf20-d59f-4b5e-b935-ddfdfb77f504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69e4370-9a12-4014-9db5-827d0b9fb631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:42 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Volume 9753718d-fa4e-4005-ad75-dbe858b6afc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9753718d-fa4e-4005-ad75-dbe858b6afc7', 'volume_size': 1} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-525584495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9753718d-fa4e-4005-ad75-dbe858b6afc7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='143cbaaed41c42789e901ed82c650d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:42Z,use_quota=True,user_id='5f8a5176a15244898082f4378fef43bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Creating volume 9753718d-fa4e-4005-ad75-dbe858b6afc7 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:33:42 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9753718d-fa4e-4005-ad75-dbe858b6afc7 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:42 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9753718d-fa4e-4005-ad75-dbe858b6afc7 1073741824 Apr 16 13:33:42 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-ba8f1496-0937-4a94-8c2f-b66c5c7232e9-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-ba8f1496-0937-4a94-8c2f-b66c5c7232e9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-quobyte-ba8f1496-0937-4a94-8c2f-b66c5c7232e9" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-ba8f1496-0937-4a94-8c2f-b66c5c7232e9" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c435bc-0343-4fe7-a5e0-9b5ef8d2cf08]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:42 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9 Apr 16 13:33:42 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:42 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9753718d-fa4e-4005-ad75-dbe858b6afc7 1073741824" returned: 0 in 0.558s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9753718d-fa4e-4005-ad75-dbe858b6afc7 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:42 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9753718d-fa4e-4005-ad75-dbe858b6afc7 Apr 16 13:33:42 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:43 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9" returned: 0 in 0.499s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:43 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9 Apr 16 13:33:43 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:43 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9753718d-fa4e-4005-ad75-dbe858b6afc7" returned: 0 in 0.443s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69e4370-9a12-4014-9db5-827d0b9fb631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9753718d-fa4e-4005-ad75-dbe858b6afc7', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af52a8cd-db58-4e0c-ae22-ec4413ea315c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:43 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Volume volume-9753718d-fa4e-4005-ad75-dbe858b6afc7 (9753718d-fa4e-4005-ad75-dbe858b6afc7): created successfully Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af52a8cd-db58-4e0c-ae22-ec4413ea315c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Flow 'volume_create_manager' (20c8800f-235b-4b6e-bd1a-d0c3a354f95d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:43 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d4978236-dec2-4f9d-8e80-d56757c078e8 tempest-VolumesListTestJSON-1297188837 None] Created volume successfully. Apr 16 13:33:43 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ba8f1496-0937-4a94-8c2f-b66c5c7232e9" returned: 0 in 0.435s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-ba8f1496-0937-4a94-8c2f-b66c5c7232e9" released by "delete_volume" :: held 0.959s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] Created reservations ['303ec35d-e871-4286-8f7d-7d8d974da06f', '56d10d59-9fa5-4a64-93f0-abc62b9f9e1d', '9fda63c0-d30b-4926-8fea-3121c4ab054b', '560bf6ca-b853-4f8f-aa38-9e9979260b5e'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:43 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:33:43 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-39c9c475-b2a2-4121-83f5-797ee520f89c-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-39c9c475-b2a2-4121-83f5-797ee520f89c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-quobyte-5030e9d2-d53b-4b20-9eef-75c2d8925a03" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-5030e9d2-d53b-4b20-9eef-75c2d8925a03" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-quobyte-39c9c475-b2a2-4121-83f5-797ee520f89c" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-39c9c475-b2a2-4121-83f5-797ee520f89c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] Deleting offline snapshot 39c9c475-b2a2-4121-83f5-797ee520f89c of volume 5030e9d2-d53b-4b20-9eef-75c2d8925a03 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] snapshot_file for this snap is: volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd030ee3-fb79-4520-a077-f8f61a663b64]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:43 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c Apr 16 13:33:43 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:44 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.469s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:33:44 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] Deleted volume successfully. Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4bae07f1-dff4-4951-ae77-62931b9229a2 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-ba8f1496-0937-4a94-8c2f-b66c5c7232e9-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:44 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c" returned: 0 in 0.537s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[594e2ce2-7989-4a21-b975-1bc6ca72a6b5]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:44 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 Apr 16 13:33:44 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Flow 'volume_create_manager' (77a4b252-3b2b-4d46-86ca-7e71be5723c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd327b2-dabf-4019-8ff4-97ef14075434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd327b2-dabf-4019-8ff4-97ef14075434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1266177433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af3a3c6-c9f1-4b2d-8443-e95ff24af659,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='143cbaaed41c42789e901ed82c650d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:44Z,use_quota=True,user_id='5f8a5176a15244898082f4378fef43bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a08e6c-e0a4-40a2-bec0-31a382100303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a08e6c-e0a4-40a2-bec0-31a382100303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52fa9fd-11c3-490f-a335-ee06dc650106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52fa9fd-11c3-490f-a335-ee06dc650106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2af3a3c6-c9f1-4b2d-8443-e95ff24af659', 'volume_name': 'volume-2af3a3c6-c9f1-4b2d-8443-e95ff24af659', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd62842-f5a5-45f1-8540-5d2988396298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd62842-f5a5-45f1-8540-5d2988396298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066c4c20-6fce-4959-a4f7-19b1ba362204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:44 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Volume 2af3a3c6-c9f1-4b2d-8443-e95ff24af659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2af3a3c6-c9f1-4b2d-8443-e95ff24af659', 'volume_size': 1} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1266177433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af3a3c6-c9f1-4b2d-8443-e95ff24af659,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='143cbaaed41c42789e901ed82c650d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:44Z,use_quota=True,user_id='5f8a5176a15244898082f4378fef43bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Creating volume 2af3a3c6-c9f1-4b2d-8443-e95ff24af659 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:33:44 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2af3a3c6-c9f1-4b2d-8443-e95ff24af659 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:44 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2af3a3c6-c9f1-4b2d-8443-e95ff24af659 1073741824 Apr 16 13:33:44 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:44 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03" returned: 0 in 0.529s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:44 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c Apr 16 13:33:44 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:45 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2af3a3c6-c9f1-4b2d-8443-e95ff24af659 1073741824" returned: 0 in 0.494s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2af3a3c6-c9f1-4b2d-8443-e95ff24af659 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:45 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2af3a3c6-c9f1-4b2d-8443-e95ff24af659 Apr 16 13:33:45 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:45 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c" returned: 0 in 0.498s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:45 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c Apr 16 13:33:45 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:45 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2af3a3c6-c9f1-4b2d-8443-e95ff24af659" returned: 0 in 0.431s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:45 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:33:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:45 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066c4c20-6fce-4959-a4f7-19b1ba362204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2af3a3c6-c9f1-4b2d-8443-e95ff24af659', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:45 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6b9316-f961-467c-ba90-a1d9ca08b238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:45 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Volume volume-2af3a3c6-c9f1-4b2d-8443-e95ff24af659 (2af3a3c6-c9f1-4b2d-8443-e95ff24af659): created successfully Apr 16 13:33:45 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6b9316-f961-467c-ba90-a1d9ca08b238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:45 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Flow 'volume_create_manager' (77a4b252-3b2b-4d46-86ca-7e71be5723c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:45 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-45d08f86-23b1-416c-97f4-0e6cfe9f3b3d tempest-VolumesListTestJSON-1297188837 None] Created volume successfully. Apr 16 13:33:45 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03.39c9c475-b2a2-4121-83f5-797ee520f89c" returned: 0 in 0.431s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-39c9c475-b2a2-4121-83f5-797ee520f89c" released by "_delete_snapshot" :: held 2.048s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-5030e9d2-d53b-4b20-9eef-75c2d8925a03" released by "delete_snapshot" :: held 2.061s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:45 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] Created reservations ['87a9787d-bea7-4db9-bc36-5a62152310c4', '5a74f274-9559-4e40-9100-16f940096308', '424a6c19-558a-4e39-99d4-86fa2902bf5d', '62afeadd-384b-42ab-aa36-0ef94b476d07'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:33:45 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] Delete snapshot completed successfully. Apr 16 13:33:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-3a486cca-361c-4915-b8e4-7adf5a7778e6 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-39c9c475-b2a2-4121-83f5-797ee520f89c-delete_snapshot" released by "delete_snapshot" :: held 2.143s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Flow 'volume_create_manager' (0a6570e6-eb8c-4f44-a35d-1c8b0ea172dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec45c2b9-8c43-4802-a385-d4bb3c2a05ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec45c2b9-8c43-4802-a385-d4bb3c2a05ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1824690998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beee4846-2c1b-4363-81e7-7029162299ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='143cbaaed41c42789e901ed82c650d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:47Z,use_quota=True,user_id='5f8a5176a15244898082f4378fef43bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48e1154-db58-4f31-8857-317d7505ad6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48e1154-db58-4f31-8857-317d7505ad6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622a3dea-1f53-4bf8-8b63-36641966e035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622a3dea-1f53-4bf8-8b63-36641966e035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beee4846-2c1b-4363-81e7-7029162299ed', 'volume_name': 'volume-beee4846-2c1b-4363-81e7-7029162299ed', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e920745-686a-4d3d-9e5a-d3b2dea6b9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e920745-686a-4d3d-9e5a-d3b2dea6b9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a92bfea-fc52-461c-94ab-e9986b1d4244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:46 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Volume beee4846-2c1b-4363-81e7-7029162299ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beee4846-2c1b-4363-81e7-7029162299ed', 'volume_size': 1} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1824690998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beee4846-2c1b-4363-81e7-7029162299ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='143cbaaed41c42789e901ed82c650d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:47Z,use_quota=True,user_id='5f8a5176a15244898082f4378fef43bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Creating volume beee4846-2c1b-4363-81e7-7029162299ed {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:33:46 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beee4846-2c1b-4363-81e7-7029162299ed 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-5030e9d2-d53b-4b20-9eef-75c2d8925a03-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:46 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beee4846-2c1b-4363-81e7-7029162299ed 1073741824 Apr 16 13:33:46 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-5030e9d2-d53b-4b20-9eef-75c2d8925a03-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-quobyte-5030e9d2-d53b-4b20-9eef-75c2d8925a03" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-5030e9d2-d53b-4b20-9eef-75c2d8925a03" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e542d2-2401-49be-b860-2a71b1adcfef]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:47 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 Apr 16 13:33:47 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:47 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beee4846-2c1b-4363-81e7-7029162299ed 1073741824" returned: 0 in 0.493s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beee4846-2c1b-4363-81e7-7029162299ed {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:47 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beee4846-2c1b-4363-81e7-7029162299ed Apr 16 13:33:47 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:47 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03" returned: 0 in 0.519s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:47 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03 Apr 16 13:33:47 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:47 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beee4846-2c1b-4363-81e7-7029162299ed" returned: 0 in 0.430s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:47 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:33:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a92bfea-fc52-461c-94ab-e9986b1d4244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beee4846-2c1b-4363-81e7-7029162299ed', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d267867-8487-4f33-b518-133b5c5b053b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:47 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Volume volume-beee4846-2c1b-4363-81e7-7029162299ed (beee4846-2c1b-4363-81e7-7029162299ed): created successfully Apr 16 13:33:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d267867-8487-4f33-b518-133b5c5b053b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:47 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Flow 'volume_create_manager' (0a6570e6-eb8c-4f44-a35d-1c8b0ea172dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:47 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-a4d337f1-4dc9-4374-beb9-228ed7f3d2d8 tempest-VolumesListTestJSON-1297188837 None] Created volume successfully. Apr 16 13:33:47 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5030e9d2-d53b-4b20-9eef-75c2d8925a03" returned: 0 in 0.483s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:47 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-5030e9d2-d53b-4b20-9eef-75c2d8925a03" released by "delete_volume" :: held 1.030s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:48 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] Created reservations ['3dd27608-e7bd-4895-b8d3-2c604f0339f8', '2db4b3d9-1db3-48a3-a924-7990fa066c9f', '44f1ecbd-da1c-4462-be59-359a15000bc6', '7cb2a3cf-7867-40cc-8058-a478d02a383b'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:33:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:48 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:48 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:33:48 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:48 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.409s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:48 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:33:48 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] Deleted volume successfully. Apr 16 13:33:48 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a59771c6-e5b1-4be8-b10c-243e3e1f08b1 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-5030e9d2-d53b-4b20-9eef-75c2d8925a03-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Flow 'volume_create_manager' (b8319f44-9326-469c-b9d1-84d286435118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfacf931-427e-4e88-8b29-e794e73ae81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfacf931-427e-4e88-8b29-e794e73ae81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-272982137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67143a21-09b9-4b17-80ce-0340d5235cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d9f5a09b945e9a9cc5dcad09bc789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:49Z,use_quota=True,user_id='cf82ff471fa4471c9740038f919bf3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b2c777-5b47-472e-9094-1f611d93537b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b2c777-5b47-472e-9094-1f611d93537b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d50d790-50c3-4b3a-92d9-6bc4abee6134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d50d790-50c3-4b3a-92d9-6bc4abee6134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67143a21-09b9-4b17-80ce-0340d5235cb3', 'volume_name': 'volume-67143a21-09b9-4b17-80ce-0340d5235cb3', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e660a3-2d18-4625-b01a-e7c30d8f3ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e660a3-2d18-4625-b01a-e7c30d8f3ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e45b935-db8f-45ae-93ea-ea13a392d74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:49 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Volume 67143a21-09b9-4b17-80ce-0340d5235cb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67143a21-09b9-4b17-80ce-0340d5235cb3', 'volume_size': 1} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-272982137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67143a21-09b9-4b17-80ce-0340d5235cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d9f5a09b945e9a9cc5dcad09bc789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:49Z,use_quota=True,user_id='cf82ff471fa4471c9740038f919bf3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Creating volume 67143a21-09b9-4b17-80ce-0340d5235cb3 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:33:49 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:49 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 1073741824 Apr 16 13:33:49 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:49 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 1073741824" returned: 0 in 0.557s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:49 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 Apr 16 13:33:49 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:50 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3" returned: 0 in 0.444s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:50 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:33:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:50 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e45b935-db8f-45ae-93ea-ea13a392d74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67143a21-09b9-4b17-80ce-0340d5235cb3', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:50 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6435b1a0-549e-43b5-80da-ef3603bb361a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:50 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Volume volume-67143a21-09b9-4b17-80ce-0340d5235cb3 (67143a21-09b9-4b17-80ce-0340d5235cb3): created successfully Apr 16 13:33:50 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6435b1a0-549e-43b5-80da-ef3603bb361a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:50 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Flow 'volume_create_manager' (b8319f44-9326-469c-b9d1-84d286435118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:50 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d2cb1d74-dbd6-4822-890c-3dbe81dde0f4 tempest-VolumesSnapshotTestJSON-999810695 None] Created volume successfully. Apr 16 13:33:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] Acquiring lock "cinder-beee4846-2c1b-4363-81e7-7029162299ed-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] Lock "cinder-beee4846-2c1b-4363-81e7-7029162299ed-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] Acquiring lock "cinder-quobyte-beee4846-2c1b-4363-81e7-7029162299ed" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] Lock "cinder-quobyte-beee4846-2c1b-4363-81e7-7029162299ed" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:50 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dfbcf1-0526-44ba-bd29-78d9174aea89]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beee4846-2c1b-4363-81e7-7029162299ed {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:51 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beee4846-2c1b-4363-81e7-7029162299ed Apr 16 13:33:51 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:51 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beee4846-2c1b-4363-81e7-7029162299ed" returned: 0 in 0.494s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beee4846-2c1b-4363-81e7-7029162299ed {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:51 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beee4846-2c1b-4363-81e7-7029162299ed Apr 16 13:33:51 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:51 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] Creating offline snapshot 3bc38d4a-f571-4d21-94e9-21363f840795 of volume 67143a21-09b9-4b17-80ce-0340d5235cb3 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:33:51 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac97cb72-0613-49cf-b64d-94ef085f1938]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:51 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 Apr 16 13:33:51 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:51 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beee4846-2c1b-4363-81e7-7029162299ed" returned: 0 in 0.471s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] Lock "cinder-quobyte-beee4846-2c1b-4363-81e7-7029162299ed" released by "delete_volume" :: held 0.990s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:51 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] Created reservations ['37fef666-e595-44aa-bf31-59196015ec13', '85b2d775-d2f3-4caf-9b2a-ed4d746131fb', 'f5335f7c-e71a-4733-a357-a92515ae3fed', '46e35580-67da-42f0-a19f-f6dcb5a9922b'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:33:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:52 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3" returned: 0 in 0.510s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:52 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:33:52 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:52 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795 1G Apr 16 13:33:52 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:52 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.445s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:52 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:33:52 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] Deleted volume successfully. Apr 16 13:33:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-99f4de21-2b8f-4e00-b958-167376eb2c2f tempest-VolumesListTestJSON-1297188837 None] Lock "cinder-beee4846-2c1b-4363-81e7-7029162299ed-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:52 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795 1G" returned: 0 in 0.488s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67143a21-09b9-4b17-80ce-0340d5235cb3 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:52 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67143a21-09b9-4b17-80ce-0340d5235cb3 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795 Apr 16 13:33:52 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:52 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67143a21-09b9-4b17-80ce-0340d5235cb3 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795" returned: 0 in 0.453s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:53 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795 is being set with open permissions: ugo+rw Apr 16 13:33:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:53 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795 Apr 16 13:33:53 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] Acquiring lock "cinder-2af3a3c6-c9f1-4b2d-8443-e95ff24af659-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] Lock "cinder-2af3a3c6-c9f1-4b2d-8443-e95ff24af659-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] Acquiring lock "cinder-quobyte-2af3a3c6-c9f1-4b2d-8443-e95ff24af659" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] Lock "cinder-quobyte-2af3a3c6-c9f1-4b2d-8443-e95ff24af659" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:53 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[193ac45a-8c90-4601-ba9e-ef5c69275c05]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2af3a3c6-c9f1-4b2d-8443-e95ff24af659 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:53 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2af3a3c6-c9f1-4b2d-8443-e95ff24af659 Apr 16 13:33:53 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:53 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795" returned: 0 in 0.411s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:53 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.info Apr 16 13:33:53 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:53 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2af3a3c6-c9f1-4b2d-8443-e95ff24af659" returned: 0 in 0.520s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2af3a3c6-c9f1-4b2d-8443-e95ff24af659 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:53 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2af3a3c6-c9f1-4b2d-8443-e95ff24af659 Apr 16 13:33:53 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:53 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.info" returned: 0 in 0.406s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:53 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.info is being set with open permissions: ugo+rw Apr 16 13:33:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:53 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.info Apr 16 13:33:53 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:54 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2af3a3c6-c9f1-4b2d-8443-e95ff24af659" returned: 0 in 0.410s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] Lock "cinder-quobyte-2af3a3c6-c9f1-4b2d-8443-e95ff24af659" released by "delete_volume" :: held 0.951s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] Created reservations ['cf599911-bc63-4b41-85e1-4f1d6b918c3e', '680f6f0e-9b1a-4ba0-b9a0-40cf0ba4a103', '554b1bc3-8461-421e-9c81-0dc72abd3308', '6c6260cc-6fea-4b0d-b822-a7bfe9e28ea3'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:54 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:33:54 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:54 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.info" returned: 0 in 0.461s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.783s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] Acquiring lock "cinder-9753718d-fa4e-4005-ad75-dbe858b6afc7-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:54 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-b06d5f09-4539-4505-ac47-781952ee10e0 tempest-VolumesSnapshotTestJSON-999810695 None] Create snapshot completed successfully Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] Lock "cinder-9753718d-fa4e-4005-ad75-dbe858b6afc7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] Acquiring lock "cinder-quobyte-9753718d-fa4e-4005-ad75-dbe858b6afc7" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] Lock "cinder-quobyte-9753718d-fa4e-4005-ad75-dbe858b6afc7" acquired by "delete_volume" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e47919a-f69b-4c51-ab91-40dfe303fde0]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9753718d-fa4e-4005-ad75-dbe858b6afc7 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:54 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9753718d-fa4e-4005-ad75-dbe858b6afc7 Apr 16 13:33:54 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:54 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.458s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:33:54 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] Deleted volume successfully. Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-90eb9d9b-f049-40fb-9604-5414c63f6e3f tempest-VolumesListTestJSON-1297188837 None] Lock "cinder-2af3a3c6-c9f1-4b2d-8443-e95ff24af659-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:33:54 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Flow 'volume_create_manager' (9b5cbf7c-b3d6-4cfe-9932-52f383dcc0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f92ea747-afa6-4c65-abfe-2e19f9640f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9753718d-fa4e-4005-ad75-dbe858b6afc7" returned: 0 in 0.557s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9753718d-fa4e-4005-ad75-dbe858b6afc7 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f92ea747-afa6-4c65-abfe-2e19f9640f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1453042859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e3ef86-dd2e-467e-8292-0cd4854ba570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d9f5a09b945e9a9cc5dcad09bc789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3bc38d4a-f571-4d21-94e9-21363f840795,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:55Z,use_quota=True,user_id='cf82ff471fa4471c9740038f919bf3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:54 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9753718d-fa4e-4005-ad75-dbe858b6afc7 Apr 16 13:33:54 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d835f266-492f-4582-b3c5-df0838aad431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d835f266-492f-4582-b3c5-df0838aad431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f45f040b-81c8-48c7-88dc-75a0501b0d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f45f040b-81c8-48c7-88dc-75a0501b0d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '55e3ef86-dd2e-467e-8292-0cd4854ba570', 'volume_name': 'volume-55e3ef86-dd2e-467e-8292-0cd4854ba570', 'volume_size': 1, 'snapshot_id': '3bc38d4a-f571-4d21-94e9-21363f840795'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1030adc5-8d6a-4d43-8994-66d725714e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1030adc5-8d6a-4d43-8994-66d725714e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:54 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7e34ba-c485-4fd9-8386-209f398de299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:55 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Volume 55e3ef86-dd2e-467e-8292-0cd4854ba570: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-55e3ef86-dd2e-467e-8292-0cd4854ba570', 'volume_size': 1, 'snapshot_id': '3bc38d4a-f571-4d21-94e9-21363f840795'} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-quobyte-3bc38d4a-f571-4d21-94e9-21363f840795-55e3ef86-dd2e-467e-8292-0cd4854ba570" by "_create_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-3bc38d4a-f571-4d21-94e9-21363f840795-55e3ef86-dd2e-467e-8292-0cd4854ba570" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Creating volume 55e3ef86-dd2e-467e-8292-0cd4854ba570 from snapshot 3bc38d4a-f571-4d21-94e9-21363f840795 {{(pid=83606) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-quobyte-55e3ef86-dd2e-467e-8292-0cd4854ba570" by "_copy_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-55e3ef86-dd2e-467e-8292-0cd4854ba570" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] snapshot: 3bc38d4a-f571-4d21-94e9-21363f840795, volume: 55e3ef86-dd2e-467e-8292-0cd4854ba570, {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7571a428-8659-4508-a508-96a741ade064]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:55 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795 Apr 16 13:33:55 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:55 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9753718d-fa4e-4005-ad75-dbe858b6afc7" returned: 0 in 0.468s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] Lock "cinder-quobyte-9753718d-fa4e-4005-ad75-dbe858b6afc7" released by "delete_volume" :: held 1.045s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] Created reservations ['fef6b355-0d08-4885-ac63-76428b920dd9', 'd47ef165-6dad-4c28-af71-eaa33ee33b97', '527aa52d-a2e0-44f3-8110-94350c0890ea', 'ddec044a-0310-4afb-ae76-75293f19c841'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:55 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795" returned: 0 in 0.469s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67143a21-09b9-4b17-80ce-0340d5235cb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Creating direct copy from snapshot {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 13:33:55 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:33:55 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a5d93d-f95b-43cd-9fed-a0b4b23b5074]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:55 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 Apr 16 13:33:55 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:55 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.448s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:33:55 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] Deleted volume successfully. Apr 16 13:33:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9be78cb8-0b62-4732-b335-b675ee76708b tempest-VolumesListTestJSON-1297188837 None] Lock "cinder-9753718d-fa4e-4005-ad75-dbe858b6afc7-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:56 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3" returned: 0 in 0.495s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:56 devstack cinder-volume[83606]: DEBUG cinder.utils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Path /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55e3ef86-dd2e-467e-8292-0cd4854ba570 not found in is_blk_device check {{(pid=83606) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 13:33:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55e3ef86-dd2e-467e-8292-0cd4854ba570 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:56 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55e3ef86-dd2e-467e-8292-0cd4854ba570 Apr 16 13:33:56 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:58 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55e3ef86-dd2e-467e-8292-0cd4854ba570" returned: 0 in 2.032s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:58 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d0643f-fbdc-4bbd-a738-f565a12d1576]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:33:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:58 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 Apr 16 13:33:58 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:58 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3" returned: 0 in 0.647s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:58 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Image conversion details: src /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55e3ef86-dd2e-467e-8292-0cd4854ba570 {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:33:58 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Converted 1024.00 MB image at 503.72 MB/s Apr 16 13:33:58 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55e3ef86-dd2e-467e-8292-0cd4854ba570 is being set with open permissions: ugo+rw Apr 16 13:33:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55e3ef86-dd2e-467e-8292-0cd4854ba570 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:58 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55e3ef86-dd2e-467e-8292-0cd4854ba570 Apr 16 13:33:58 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:59 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55e3ef86-dd2e-467e-8292-0cd4854ba570" returned: 0 in 0.424s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-55e3ef86-dd2e-467e-8292-0cd4854ba570" released by "_copy_volume_from_snapshot" :: held 4.127s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-3bc38d4a-f571-4d21-94e9-21363f840795-55e3ef86-dd2e-467e-8292-0cd4854ba570" released by "_create_volume_from_snapshot" :: held 4.141s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.149s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Flow 'volume_create_manager' (cd0166ba-7c28-48e6-bcd1-c7c1b78f3759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1787ba7e-9a19-482c-b383-cb38e4f0acb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7e34ba-c485-4fd9-8386-209f398de299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55e3ef86-dd2e-467e-8292-0cd4854ba570', 'volume_size': 1, 'snapshot_id': '3bc38d4a-f571-4d21-94e9-21363f840795'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (027a16a1-4b91-4646-b120-ae37ce601ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1787ba7e-9a19-482c-b383-cb38e4f0acb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb9f3eb-d2f9-4fce-9b77-391c0be14a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076fa99e5ea74be1b4b6ee5828be061b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:59Z,use_quota=True,user_id='9151cdbba7b04c76b26d23427ad1e3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ac9025-991e-4b44-86ab-f5d579ed41f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ac9025-991e-4b44-86ab-f5d579ed41f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400b85a0-a14d-4b89-836e-8e59af21c0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400b85a0-a14d-4b89-836e-8e59af21c0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beb9f3eb-d2f9-4fce-9b77-391c0be14a78', 'volume_name': 'volume-beb9f3eb-d2f9-4fce-9b77-391c0be14a78', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be40e82-52ac-4128-adf1-eee31fea3753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be40e82-52ac-4128-adf1-eee31fea3753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b913956-cb0b-49ea-929a-81459e7b7063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:33:59 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Volume beb9f3eb-d2f9-4fce-9b77-391c0be14a78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beb9f3eb-d2f9-4fce-9b77-391c0be14a78', 'volume_size': 1} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb9f3eb-d2f9-4fce-9b77-391c0be14a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076fa99e5ea74be1b4b6ee5828be061b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:33:59Z,use_quota=True,user_id='9151cdbba7b04c76b26d23427ad1e3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Creating volume beb9f3eb-d2f9-4fce-9b77-391c0be14a78 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:33:59 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beb9f3eb-d2f9-4fce-9b77-391c0be14a78 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:59 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Volume volume-55e3ef86-dd2e-467e-8292-0cd4854ba570 (55e3ef86-dd2e-467e-8292-0cd4854ba570): created successfully Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (027a16a1-4b91-4646-b120-ae37ce601ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Flow 'volume_create_manager' (9b5cbf7c-b3d6-4cfe-9932-52f383dcc0eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:33:59 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beb9f3eb-d2f9-4fce-9b77-391c0be14a78 1073741824 Apr 16 13:33:59 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:33:59 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-0b849ee5-bb41-40ae-95b6-a01e4d7daf85 tempest-VolumesSnapshotTestJSON-999810695 None] Created volume successfully. Apr 16 13:33:59 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beb9f3eb-d2f9-4fce-9b77-391c0be14a78 1073741824" returned: 0 in 0.455s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:33:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beb9f3eb-d2f9-4fce-9b77-391c0be14a78 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:33:59 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beb9f3eb-d2f9-4fce-9b77-391c0be14a78 Apr 16 13:33:59 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:00 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beb9f3eb-d2f9-4fce-9b77-391c0be14a78" returned: 0 in 0.393s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b913956-cb0b-49ea-929a-81459e7b7063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb9f3eb-d2f9-4fce-9b77-391c0be14a78', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974b4997-a84b-4339-bad0-096da043a443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:00 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Volume volume-beb9f3eb-d2f9-4fce-9b77-391c0be14a78 (beb9f3eb-d2f9-4fce-9b77-391c0be14a78): created successfully Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974b4997-a84b-4339-bad0-096da043a443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Flow 'volume_create_manager' (cd0166ba-7c28-48e6-bcd1-c7c1b78f3759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:34:00 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-43e8b7ca-ffe9-401a-af0a-40910fcc51e9 tempest-CinderUnicodeTest-783324753 None] Created volume successfully. Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-55e3ef86-dd2e-467e-8292-0cd4854ba570-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-55e3ef86-dd2e-467e-8292-0cd4854ba570-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-quobyte-55e3ef86-dd2e-467e-8292-0cd4854ba570" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-55e3ef86-dd2e-467e-8292-0cd4854ba570" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0b1d85-9694-4517-baa1-0c59ad014c71]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55e3ef86-dd2e-467e-8292-0cd4854ba570 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:00 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55e3ef86-dd2e-467e-8292-0cd4854ba570 Apr 16 13:34:00 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Flow 'volume_create_manager' (94f0073e-53b7-4528-8a63-84642c465cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712daddb-f269-4cf4-9064-39b5f1a3eaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712daddb-f269-4cf4-9064-39b5f1a3eaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:34:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1418362891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e995432-df82-4e6c-b3f8-25a2d81b252a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076fa99e5ea74be1b4b6ee5828be061b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:34:01Z,use_quota=True,user_id='9151cdbba7b04c76b26d23427ad1e3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5e2bbe-5d62-4ff6-8dc9-8323cc9cbc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5e2bbe-5d62-4ff6-8dc9-8323cc9cbc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67909ccc-eeef-4852-b9a2-dc8883af0736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67909ccc-eeef-4852-b9a2-dc8883af0736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e995432-df82-4e6c-b3f8-25a2d81b252a', 'volume_name': 'volume-4e995432-df82-4e6c-b3f8-25a2d81b252a', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4622b6c8-8b6f-49fd-98d6-94fd0f7a7705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4622b6c8-8b6f-49fd-98d6-94fd0f7a7705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4986ab7-e490-45ca-a3a1-82f38a3c1f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:00 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Volume 4e995432-df82-4e6c-b3f8-25a2d81b252a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e995432-df82-4e6c-b3f8-25a2d81b252a', 'volume_size': 1} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:34:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1418362891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e995432-df82-4e6c-b3f8-25a2d81b252a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076fa99e5ea74be1b4b6ee5828be061b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:34:01Z,use_quota=True,user_id='9151cdbba7b04c76b26d23427ad1e3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Creating volume 4e995432-df82-4e6c-b3f8-25a2d81b252a {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:34:00 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:00 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a 1073741824 Apr 16 13:34:00 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:00 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55e3ef86-dd2e-467e-8292-0cd4854ba570" returned: 0 in 0.471s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55e3ef86-dd2e-467e-8292-0cd4854ba570 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:00 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55e3ef86-dd2e-467e-8292-0cd4854ba570 Apr 16 13:34:00 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:01 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a 1073741824" returned: 0 in 0.465s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:01 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a Apr 16 13:34:01 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:01 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-55e3ef86-dd2e-467e-8292-0cd4854ba570" returned: 0 in 0.485s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-55e3ef86-dd2e-467e-8292-0cd4854ba570" released by "delete_volume" :: held 0.979s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] Created reservations ['607ad3a4-7f45-4ca3-b933-508d2890724d', '0ae0c5eb-4095-4e62-829a-8753b12badf1', 'a9816d93-65fd-49ce-8edf-f70be53605fc', '48a766a9-d961-4b05-a91c-67816aa2404d'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:01 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:34:01 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-3bc38d4a-f571-4d21-94e9-21363f840795-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-3bc38d4a-f571-4d21-94e9-21363f840795-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-quobyte-67143a21-09b9-4b17-80ce-0340d5235cb3" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-67143a21-09b9-4b17-80ce-0340d5235cb3" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-quobyte-3bc38d4a-f571-4d21-94e9-21363f840795" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-3bc38d4a-f571-4d21-94e9-21363f840795" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] Deleting offline snapshot 3bc38d4a-f571-4d21-94e9-21363f840795 of volume 67143a21-09b9-4b17-80ce-0340d5235cb3 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] snapshot_file for this snap is: volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cbb9d6-f650-4c0f-824e-ba03acbbf508]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:01 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795 Apr 16 13:34:01 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:01 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a" returned: 0 in 0.503s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4986ab7-e490-45ca-a3a1-82f38a3c1f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e995432-df82-4e6c-b3f8-25a2d81b252a', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3e8244-81a2-4ad0-a564-f90540615875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:01 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Volume volume-4e995432-df82-4e6c-b3f8-25a2d81b252a (4e995432-df82-4e6c-b3f8-25a2d81b252a): created successfully Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3e8244-81a2-4ad0-a564-f90540615875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Flow 'volume_create_manager' (94f0073e-53b7-4528-8a63-84642c465cf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:34:01 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-71a9c0a3-c3b5-4a78-92bc-c85633cd466b tempest-CinderUnicodeTest-783324753 None] Created volume successfully. Apr 16 13:34:01 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.415s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:34:01 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] Deleted volume successfully. Apr 16 13:34:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-882e7ee1-12c2-4c70-879e-88e0ee2d9b51 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-55e3ef86-dd2e-467e-8292-0cd4854ba570-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:02 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795" returned: 0 in 0.517s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67143a21-09b9-4b17-80ce-0340d5235cb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:34:02 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[06db7d25-a6e3-4dca-b8f4-c06b58eeb8df]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:02 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 Apr 16 13:34:02 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:02 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3" returned: 0 in 0.455s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:02 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795 Apr 16 13:34:02 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] Creating offline snapshot 310c9b8d-5583-4091-88e8-e634be9ac187 of volume 4e995432-df82-4e6c-b3f8-25a2d81b252a {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:34:02 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eef4691-739f-4fa4-a7a9-8eac8e8f69b9]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:02 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a Apr 16 13:34:02 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:02 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795" returned: 0 in 0.495s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:03 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795 Apr 16 13:34:03 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:03 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a" returned: 0 in 0.466s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:03 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187 1G Apr 16 13:34:03 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:03 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3.3bc38d4a-f571-4d21-94e9-21363f840795" returned: 0 in 0.401s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:03 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-3bc38d4a-f571-4d21-94e9-21363f840795" released by "_delete_snapshot" :: held 1.920s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:03 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-67143a21-09b9-4b17-80ce-0340d5235cb3" released by "delete_snapshot" :: held 1.930s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:03 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] Created reservations ['597f50cb-6634-4e7e-9770-d4b2c346d474', '33c2a45b-d8f3-45dc-9f1e-fe2edd634f11', 'b483a393-601d-48fa-9c42-6c7a9153662e', 'bc5fccda-e91b-48a9-9959-97d1465aede3'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:34:03 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] Delete snapshot completed successfully. Apr 16 13:34:03 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d0237e3c-bfc5-4b99-bc44-476acf3df75b tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-3bc38d4a-f571-4d21-94e9-21363f840795-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:03 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-67143a21-09b9-4b17-80ce-0340d5235cb3-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:03 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-67143a21-09b9-4b17-80ce-0340d5235cb3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:03 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-quobyte-67143a21-09b9-4b17-80ce-0340d5235cb3" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:03 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-67143a21-09b9-4b17-80ce-0340d5235cb3" acquired by "delete_volume" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:03 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58e9458-7057-4cfb-ba33-342a43b96820]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:03 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 Apr 16 13:34:03 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:03 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187 1G" returned: 0 in 0.494s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e995432-df82-4e6c-b3f8-25a2d81b252a -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:03 devstack sudo[90524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e995432-df82-4e6c-b3f8-25a2d81b252a -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187 Apr 16 13:34:03 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:04 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3" returned: 0 in 0.463s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:04 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3 Apr 16 13:34:04 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:04 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e995432-df82-4e6c-b3f8-25a2d81b252a -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187" returned: 0 in 0.434s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:04 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187 is being set with open permissions: ugo+rw Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:04 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187 Apr 16 13:34:04 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:04 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-67143a21-09b9-4b17-80ce-0340d5235cb3" returned: 0 in 0.386s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-67143a21-09b9-4b17-80ce-0340d5235cb3" released by "delete_volume" :: held 0.887s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] Created reservations ['1a3f5b4f-ece7-40f0-b6a5-e3689268106a', 'aa3f24f4-ff3f-4f43-89c7-d22004b1bafc', '29e88370-b5e4-4436-8c45-42d78c19aea0', '6e992040-1af6-4b4d-a653-757910921b6c'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:04 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:34:04 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:04 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187" returned: 0 in 0.418s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:04 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.info Apr 16 13:34:04 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-313edf4f-fa2a-455e-a10e-f8a68a29e42c-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-313edf4f-fa2a-455e-a10e-f8a68a29e42c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "cinder-quobyte-313edf4f-fa2a-455e-a10e-f8a68a29e42c" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-313edf4f-fa2a-455e-a10e-f8a68a29e42c" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebad0587-0676-4df3-ae48-11a006cc9425]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:04 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c Apr 16 13:34:04 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:05 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.427s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:34:05 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] Deleted volume successfully. Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-825f0e01-400b-4a5b-ad05-b1deb7b3de7e tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-67143a21-09b9-4b17-80ce-0340d5235cb3-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:05 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.info" returned: 0 in 0.452s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:05 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.info is being set with open permissions: ugo+rw Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:05 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.info Apr 16 13:34:05 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:05 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c" returned: 0 in 0.475s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:05 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c Apr 16 13:34:05 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:05 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.info" returned: 0 in 0.396s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.721s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:05 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-ee1344ea-7bbb-4a85-8970-93a0f7e53db1 tempest-CinderUnicodeTest-783324753 None] Create snapshot completed successfully Apr 16 13:34:05 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-313edf4f-fa2a-455e-a10e-f8a68a29e42c" returned: 0 in 0.419s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-quobyte-313edf4f-fa2a-455e-a10e-f8a68a29e42c" released by "delete_volume" :: held 0.920s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] Created reservations ['372e26c9-8052-4f83-a932-f25bce53b766', '28460a30-63d5-4f0f-99ae-6201d7e38247', 'cb35cd87-9d21-4030-b76f-a4ea1a0370af', '002f0291-d4c1-4b72-b18f-8d5d63836c93'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:05 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:34:05 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:05 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] Acquiring lock "cinder-310c9b8d-5583-4091-88e8-e634be9ac187-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] Lock "cinder-310c9b8d-5583-4091-88e8-e634be9ac187-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] Acquiring lock "cinder-quobyte-4e995432-df82-4e6c-b3f8-25a2d81b252a" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] Lock "cinder-quobyte-4e995432-df82-4e6c-b3f8-25a2d81b252a" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] Acquiring lock "cinder-quobyte-310c9b8d-5583-4091-88e8-e634be9ac187" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] Lock "cinder-quobyte-310c9b8d-5583-4091-88e8-e634be9ac187" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] Deleting offline snapshot 310c9b8d-5583-4091-88e8-e634be9ac187 of volume 4e995432-df82-4e6c-b3f8-25a2d81b252a {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:34:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] snapshot_file for this snap is: volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:34:06 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea97aac0-93f6-4faa-842d-72de74afddaa]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:06 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187 Apr 16 13:34:06 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:06 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.496s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:06 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:34:06 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] Deleted volume successfully. Apr 16 13:34:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-765590a9-c34a-40ce-9475-07bee8d41ec2 tempest-VolumesSnapshotTestJSON-999810695 None] Lock "cinder-313edf4f-fa2a-455e-a10e-f8a68a29e42c-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:06 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187" returned: 0 in 0.501s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e995432-df82-4e6c-b3f8-25a2d81b252a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:34:06 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[af087c30-ac45-4a21-bf76-6246184d2319]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:06 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a Apr 16 13:34:06 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:07 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a" returned: 0 in 0.506s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:07 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187 Apr 16 13:34:07 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:07 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187" returned: 0 in 0.510s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:07 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187 Apr 16 13:34:07 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:08 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a.310c9b8d-5583-4091-88e8-e634be9ac187" returned: 0 in 0.472s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] Lock "cinder-quobyte-310c9b8d-5583-4091-88e8-e634be9ac187" released by "_delete_snapshot" :: held 2.047s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] Lock "cinder-quobyte-4e995432-df82-4e6c-b3f8-25a2d81b252a" released by "delete_snapshot" :: held 2.057s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:08 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] Created reservations ['6bba7fdb-261a-4a45-b482-7da3109ef70b', '50e26efa-c438-4d75-b096-5856d6105c7a', '9fd3873d-a3ad-477f-b498-528bdb94d52a', '6d1d484c-6138-434e-b5a6-858f78e04bfe'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:34:08 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] Delete snapshot completed successfully. Apr 16 13:34:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fa1b7e1f-4db9-4fcd-bbe4-90f022d3d3a9 tempest-CinderUnicodeTest-783324753 None] Lock "cinder-310c9b8d-5583-4091-88e8-e634be9ac187-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] Acquiring lock "cinder-4e995432-df82-4e6c-b3f8-25a2d81b252a-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] Lock "cinder-4e995432-df82-4e6c-b3f8-25a2d81b252a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:SELECT=139,cinder:UPDATE=180,cinder:INSERT=41,cinder:DELETE=20 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] Acquiring lock "cinder-quobyte-4e995432-df82-4e6c-b3f8-25a2d81b252a" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] Lock "cinder-quobyte-4e995432-df82-4e6c-b3f8-25a2d81b252a" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a485f0-e795-407c-a139-cb05252f898f]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:09 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a Apr 16 13:34:09 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Flow 'volume_create_manager' (367a6306-52ba-4641-909f-14ff636b45b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a02c1540-cff8-4f18-878d-7953d32ee0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a02c1540-cff8-4f18-878d-7953d32ee0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-549489185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2684f7d0-3a94-49fb-8b0f-279dcf89bec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd953019b044ff69a612736550721b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:34:10Z,use_quota=True,user_id='641137009cce4473998cbb6bc6aae1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6893b9a1-7b12-4057-bed7-2b77d9326ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6893b9a1-7b12-4057-bed7-2b77d9326ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c863c9ab-490b-48f8-b341-504145df4816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c863c9ab-490b-48f8-b341-504145df4816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2684f7d0-3a94-49fb-8b0f-279dcf89bec5', 'volume_name': 'volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e790f6-b8c1-4bc6-96d1-9f438a03d5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:09 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e790f6-b8c1-4bc6-96d1-9f438a03d5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c44363-c4bc-450f-a2a3-527c17140ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:09 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Volume 2684f7d0-3a94-49fb-8b0f-279dcf89bec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5', 'volume_size': 1} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-549489185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2684f7d0-3a94-49fb-8b0f-279dcf89bec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd953019b044ff69a612736550721b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:34:10Z,use_quota=True,user_id='641137009cce4473998cbb6bc6aae1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Creating volume 2684f7d0-3a94-49fb-8b0f-279dcf89bec5 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:34:09 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a" returned: 0 in 0.510s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:09 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5 1073741824 Apr 16 13:34:09 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:09 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a Apr 16 13:34:09 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:10 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-4e995432-df82-4e6c-b3f8-25a2d81b252a" returned: 0 in 0.450s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] Lock "cinder-quobyte-4e995432-df82-4e6c-b3f8-25a2d81b252a" released by "delete_volume" :: held 0.990s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:10 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5 1073741824" returned: 0 in 0.499s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] Created reservations ['b0b62bf2-ec4a-47e0-94b2-228634db47c7', 'd2b7a1db-4cd0-4e09-bfd8-f78bd7e33dc5', '6ecb215e-4965-4a91-9346-39aaf52a3cb8', 'b1c80bb5-a6d6-4503-83e4-e2cfc7d16e44'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:10 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5 Apr 16 13:34:10 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:10 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:34:10 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:10 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5" returned: 0 in 0.424s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c44363-c4bc-450f-a2a3-527c17140ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5915489d-ab97-4360-88b5-1f55398f3934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:10 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:10 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Volume volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5 (2684f7d0-3a94-49fb-8b0f-279dcf89bec5): created successfully Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5915489d-ab97-4360-88b5-1f55398f3934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Flow 'volume_create_manager' (367a6306-52ba-4641-909f-14ff636b45b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.422s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:34:10 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] Deleted volume successfully. Apr 16 13:34:10 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-23acce86-99f9-48b1-9e87-bc57bb7672f2 tempest-VolumesSnapshotListTestJSON-2000337057 None] Created volume successfully. Apr 16 13:34:10 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e86bc462-0e10-4c69-8ef5-7c4a161ad599 tempest-CinderUnicodeTest-783324753 None] Lock "cinder-4e995432-df82-4e6c-b3f8-25a2d81b252a-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:11 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] Acquiring lock "cinder-beb9f3eb-d2f9-4fce-9b77-391c0be14a78-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:11 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] Lock "cinder-beb9f3eb-d2f9-4fce-9b77-391c0be14a78-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:11 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] Acquiring lock "cinder-quobyte-beb9f3eb-d2f9-4fce-9b77-391c0be14a78" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:11 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] Lock "cinder-quobyte-beb9f3eb-d2f9-4fce-9b77-391c0be14a78" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:11 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbe9960-8428-46eb-b4a1-12421ac13cfa]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beb9f3eb-d2f9-4fce-9b77-391c0be14a78 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:11 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beb9f3eb-d2f9-4fce-9b77-391c0be14a78 Apr 16 13:34:11 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:11 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beb9f3eb-d2f9-4fce-9b77-391c0be14a78" returned: 0 in 0.474s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beb9f3eb-d2f9-4fce-9b77-391c0be14a78 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:11 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beb9f3eb-d2f9-4fce-9b77-391c0be14a78 Apr 16 13:34:11 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] Creating offline snapshot 0f386eb6-8a03-40e0-97af-bae9c4e20353 of volume 2684f7d0-3a94-49fb-8b0f-279dcf89bec5 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a90eed9-bd72-4cf3-bc81-a7990daa541c]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:12 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5 Apr 16 13:34:12 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:12 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-beb9f3eb-d2f9-4fce-9b77-391c0be14a78" returned: 0 in 0.424s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] Lock "cinder-quobyte-beb9f3eb-d2f9-4fce-9b77-391c0be14a78" released by "delete_volume" :: held 0.919s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] Created reservations ['e5bb61bc-e4e4-475e-9305-30364022faa2', '7bf3ea2c-25d0-4849-b9fb-8184c3056274', '47a0b33d-94db-4a22-abef-133caad20f00', 'e75f32c7-c884-4322-a367-c1c17ee65bf9'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:12 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:34:12 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:12 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5" returned: 0 in 0.511s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:12 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 1G Apr 16 13:34:12 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:12 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.423s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:34:12 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] Deleted volume successfully. Apr 16 13:34:12 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d638face-8b70-4482-8cdc-d4c125e65331 tempest-CinderUnicodeTest-783324753 None] Lock "cinder-beb9f3eb-d2f9-4fce-9b77-391c0be14a78-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:13 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 1G" returned: 0 in 0.568s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:13 devstack sudo[90618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 Apr 16 13:34:13 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:13 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353" returned: 0 in 0.447s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:13 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 is being set with open permissions: ugo+rw Apr 16 13:34:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:13 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 Apr 16 13:34:13 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:13 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353" returned: 0 in 0.399s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:14 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.info Apr 16 13:34:14 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:14 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.info" returned: 0 in 0.399s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:14 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.info is being set with open permissions: ugo+rw Apr 16 13:34:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:14 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.info Apr 16 13:34:14 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:14 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.info" returned: 0 in 0.392s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.765s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:14 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-8ccf1423-9664-4ec9-8a5b-b3e5c29094ee tempest-VolumesSnapshotListTestJSON-2000337057 None] Create snapshot completed successfully Apr 16 13:34:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-413da2d4-d35d-4ef0-ab46-55f9c23846d8 tempest-VolumesSnapshotListTestJSON-2000337057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-413da2d4-d35d-4ef0-ab46-55f9c23846d8 tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-413da2d4-d35d-4ef0-ab46-55f9c23846d8 tempest-VolumesSnapshotListTestJSON-2000337057 None] Creating offline snapshot cd0befef-8460-4e40-83ad-92e064074464 of volume 2684f7d0-3a94-49fb-8b0f-279dcf89bec5 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:34:15 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20b0f02-1a02-4b9a-a8f0-4374fe2e518c]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-413da2d4-d35d-4ef0-ab46-55f9c23846d8 tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:15 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 Apr 16 13:34:15 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:15 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-413da2d4-d35d-4ef0-ab46-55f9c23846d8 tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353" returned: 0 in 0.454s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-413da2d4-d35d-4ef0-ab46-55f9c23846d8 tempest-VolumesSnapshotListTestJSON-2000337057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:34:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-413da2d4-d35d-4ef0-ab46-55f9c23846d8 tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:15 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 1G Apr 16 13:34:15 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:16 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-413da2d4-d35d-4ef0-ab46-55f9c23846d8 tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 1G" returned: 0 in 0.458s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-413da2d4-d35d-4ef0-ab46-55f9c23846d8 tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:16 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 Apr 16 13:34:16 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:16 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-413da2d4-d35d-4ef0-ab46-55f9c23846d8 tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464" returned: 0 in 0.408s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:16 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-413da2d4-d35d-4ef0-ab46-55f9c23846d8 tempest-VolumesSnapshotListTestJSON-2000337057 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 is being set with open permissions: ugo+rw Apr 16 13:34:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-413da2d4-d35d-4ef0-ab46-55f9c23846d8 tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:16 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 Apr 16 13:34:16 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:16 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-413da2d4-d35d-4ef0-ab46-55f9c23846d8 tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464" returned: 0 in 0.392s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-413da2d4-d35d-4ef0-ab46-55f9c23846d8 tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.767s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:17 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-413da2d4-d35d-4ef0-ab46-55f9c23846d8 tempest-VolumesSnapshotListTestJSON-2000337057 None] Create snapshot completed successfully Apr 16 13:34:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-16ac4e0a-dfcc-406c-83de-16d669f92eba tempest-VolumesSnapshotListTestJSON-2000337057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-16ac4e0a-dfcc-406c-83de-16d669f92eba tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-16ac4e0a-dfcc-406c-83de-16d669f92eba tempest-VolumesSnapshotListTestJSON-2000337057 None] Creating offline snapshot 38c7b3ee-1c95-4f13-ad34-346bec7304ec of volume 2684f7d0-3a94-49fb-8b0f-279dcf89bec5 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:34:17 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[744cf280-912c-4e0a-97cd-705d12e5ebee]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-16ac4e0a-dfcc-406c-83de-16d669f92eba tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:17 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 Apr 16 13:34:17 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:17 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-16ac4e0a-dfcc-406c-83de-16d669f92eba tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464" returned: 0 in 0.459s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-16ac4e0a-dfcc-406c-83de-16d669f92eba tempest-VolumesSnapshotListTestJSON-2000337057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:34:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-16ac4e0a-dfcc-406c-83de-16d669f92eba tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:17 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec 1G Apr 16 13:34:17 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:18 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-16ac4e0a-dfcc-406c-83de-16d669f92eba tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec 1G" returned: 0 in 0.528s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-16ac4e0a-dfcc-406c-83de-16d669f92eba tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:18 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec Apr 16 13:34:18 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:18 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-16ac4e0a-dfcc-406c-83de-16d669f92eba tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec" returned: 0 in 0.410s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:18 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-16ac4e0a-dfcc-406c-83de-16d669f92eba tempest-VolumesSnapshotListTestJSON-2000337057 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec is being set with open permissions: ugo+rw Apr 16 13:34:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-16ac4e0a-dfcc-406c-83de-16d669f92eba tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:18 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec Apr 16 13:34:18 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:19 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-16ac4e0a-dfcc-406c-83de-16d669f92eba tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec" returned: 0 in 0.408s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-16ac4e0a-dfcc-406c-83de-16d669f92eba tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:19 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-16ac4e0a-dfcc-406c-83de-16d669f92eba tempest-VolumesSnapshotListTestJSON-2000337057 None] Create snapshot completed successfully Apr 16 13:34:20 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Acquiring lock "cinder-38c7b3ee-1c95-4f13-ad34-346bec7304ec-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:20 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-38c7b3ee-1c95-4f13-ad34-346bec7304ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:20 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Acquiring lock "cinder-quobyte-2684f7d0-3a94-49fb-8b0f-279dcf89bec5" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:20 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-quobyte-2684f7d0-3a94-49fb-8b0f-279dcf89bec5" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:20 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Acquiring lock "cinder-quobyte-38c7b3ee-1c95-4f13-ad34-346bec7304ec" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:20 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-quobyte-38c7b3ee-1c95-4f13-ad34-346bec7304ec" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Deleting offline snapshot 38c7b3ee-1c95-4f13-ad34-346bec7304ec of volume 2684f7d0-3a94-49fb-8b0f-279dcf89bec5 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:34:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] snapshot_file for this snap is: volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:34:20 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11aaafd-8730-4059-b334-6ca078edc794]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:20 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec Apr 16 13:34:20 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:20 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec" returned: 0 in 0.450s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:34:20 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7938f81c-1cd9-4ccb-93ef-21f9f12df72d]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:20 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 Apr 16 13:34:20 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:21 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464" returned: 0 in 0.473s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:21 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:34:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:21 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec Apr 16 13:34:21 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:21 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec" returned: 0 in 0.454s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:21 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec Apr 16 13:34:21 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:22 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.38c7b3ee-1c95-4f13-ad34-346bec7304ec" returned: 0 in 0.396s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-quobyte-38c7b3ee-1c95-4f13-ad34-346bec7304ec" released by "_delete_snapshot" :: held 1.818s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-quobyte-2684f7d0-3a94-49fb-8b0f-279dcf89bec5" released by "delete_snapshot" :: held 1.829s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:SELECT=163,cinder:INSERT=55,cinder:UPDATE=166,cinder:DELETE=12 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Created reservations ['2dc24151-e9c5-4aa9-b318-ca2e0419dde0', '847191f7-6962-43de-951f-dead8cc2391d', 'ed82fc79-f7df-48a6-9a38-f95b41b59671', '0a5073c3-ce04-4e0f-9637-592e4e05b915'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:34:22 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Delete snapshot completed successfully. Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e87cb9e1-133a-46c5-b460-71b0c51bad4e tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-38c7b3ee-1c95-4f13-ad34-346bec7304ec-delete_snapshot" released by "delete_snapshot" :: held 1.905s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Acquiring lock "cinder-cd0befef-8460-4e40-83ad-92e064074464-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-cd0befef-8460-4e40-83ad-92e064074464-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Acquiring lock "cinder-quobyte-2684f7d0-3a94-49fb-8b0f-279dcf89bec5" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-quobyte-2684f7d0-3a94-49fb-8b0f-279dcf89bec5" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Acquiring lock "cinder-quobyte-cd0befef-8460-4e40-83ad-92e064074464" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-quobyte-cd0befef-8460-4e40-83ad-92e064074464" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Deleting offline snapshot cd0befef-8460-4e40-83ad-92e064074464 of volume 2684f7d0-3a94-49fb-8b0f-279dcf89bec5 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] snapshot_file for this snap is: volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1b5027-8a0d-4a6b-a013-beef28d3ffa5]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:22 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 Apr 16 13:34:22 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:22 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464" returned: 0 in 0.446s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e740d64-f783-423c-868e-c80b4f9ecea1]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:22 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 Apr 16 13:34:22 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:23 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353" returned: 0 in 0.458s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:23 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:34:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:23 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 Apr 16 13:34:23 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:23 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464" returned: 0 in 0.444s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:23 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464 Apr 16 13:34:23 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:24 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.cd0befef-8460-4e40-83ad-92e064074464" returned: 0 in 0.387s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-quobyte-cd0befef-8460-4e40-83ad-92e064074464" released by "_delete_snapshot" :: held 1.778s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-quobyte-2684f7d0-3a94-49fb-8b0f-279dcf89bec5" released by "delete_snapshot" :: held 1.789s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Created reservations ['e67f4133-c0c8-48cb-a9bc-53e1765800d2', 'f07e243a-4b68-4a4e-b5e3-3e8ee778a0f6', '5bbd25e1-b13d-4e57-9f0d-af25afb129ad', '6a5ce7ed-efea-42b2-9cd8-528811a64321'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:34:24 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Delete snapshot completed successfully. Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-cb2bd927-6834-43f1-bcd7-206f558042ec tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-cd0befef-8460-4e40-83ad-92e064074464-delete_snapshot" released by "delete_snapshot" :: held 1.864s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] Acquiring lock "cinder-0f386eb6-8a03-40e0-97af-bae9c4e20353-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-0f386eb6-8a03-40e0-97af-bae9c4e20353-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] Acquiring lock "cinder-quobyte-2684f7d0-3a94-49fb-8b0f-279dcf89bec5" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-quobyte-2684f7d0-3a94-49fb-8b0f-279dcf89bec5" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] Acquiring lock "cinder-quobyte-0f386eb6-8a03-40e0-97af-bae9c4e20353" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-quobyte-0f386eb6-8a03-40e0-97af-bae9c4e20353" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] Deleting offline snapshot 0f386eb6-8a03-40e0-97af-bae9c4e20353 of volume 2684f7d0-3a94-49fb-8b0f-279dcf89bec5 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] snapshot_file for this snap is: volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc35a84-439c-4fcb-8548-49ce8391dd67]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:24 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 Apr 16 13:34:24 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:24 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353" returned: 0 in 0.452s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cb52b0-61b0-4dcc-82b9-61f92ede6a10]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:25 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5 Apr 16 13:34:25 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:25 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5" returned: 0 in 0.445s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:25 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 Apr 16 13:34:25 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:25 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353" returned: 0 in 0.428s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:25 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353 Apr 16 13:34:25 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:26 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5.0f386eb6-8a03-40e0-97af-bae9c4e20353" returned: 0 in 0.388s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-quobyte-0f386eb6-8a03-40e0-97af-bae9c4e20353" released by "_delete_snapshot" :: held 1.762s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-quobyte-2684f7d0-3a94-49fb-8b0f-279dcf89bec5" released by "delete_snapshot" :: held 1.777s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:26 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] Created reservations ['94c006c9-450f-4e59-8809-0a1e748ad6cc', '8a394b72-da0f-416a-bc86-d8182e8264b3', '3d3a30f3-a2f8-4843-9984-14eff9e097ec', '501c28fd-52d1-4769-ac8b-8334f765d27c'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:34:26 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] Delete snapshot completed successfully. Apr 16 13:34:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-22a26c07-fada-417b-87e6-885d7e6abbeb tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-0f386eb6-8a03-40e0-97af-bae9c4e20353-delete_snapshot" released by "delete_snapshot" :: held 1.878s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] Acquiring lock "cinder-2684f7d0-3a94-49fb-8b0f-279dcf89bec5-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-2684f7d0-3a94-49fb-8b0f-279dcf89bec5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] Acquiring lock "cinder-quobyte-2684f7d0-3a94-49fb-8b0f-279dcf89bec5" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-quobyte-2684f7d0-3a94-49fb-8b0f-279dcf89bec5" acquired by "delete_volume" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:26 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f61f16-a986-41ab-82ea-7e69e06aef5e]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:26 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5 Apr 16 13:34:26 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:27 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5" returned: 0 in 0.438s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:27 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5 Apr 16 13:34:27 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:27 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2684f7d0-3a94-49fb-8b0f-279dcf89bec5" returned: 0 in 0.388s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-quobyte-2684f7d0-3a94-49fb-8b0f-279dcf89bec5" released by "delete_volume" :: held 0.861s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:27 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] Created reservations ['fe6f35e1-33b6-40b5-aafb-4b2eafc90fbe', '97c87f3b-093c-4562-89b8-c0c4c55cf993', '272127ec-fed3-4db4-9578-39deece9fe3a', '93a79d70-ae09-4db3-b973-b9ccea7e0059'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:34:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:27 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:34:27 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:28 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.452s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:28 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:34:28 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] Deleted volume successfully. Apr 16 13:34:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-14e98d67-19b3-4e02-b8ee-906b8633bab3 tempest-VolumesSnapshotListTestJSON-2000337057 None] Lock "cinder-2684f7d0-3a94-49fb-8b0f-279dcf89bec5-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Flow 'volume_create_manager' (7c2c95e6-eda1-45a4-8f2d-0858ad813eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5286d389-b899-476e-9293-862683555c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5286d389-b899-476e-9293-862683555c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1050751316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689f3689-a0a1-4f34-9ad1-79ad6d9e184d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169d6683729543d0b687e2a0b671d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:34:29Z,use_quota=True,user_id='7cfce396b5c7483c8110b8769d2b8889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322f1520-73b1-499b-954d-3b7df98e58eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322f1520-73b1-499b-954d-3b7df98e58eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6974e057-0145-4fd7-b4e5-aea7f16b63f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6974e057-0145-4fd7-b4e5-aea7f16b63f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '689f3689-a0a1-4f34-9ad1-79ad6d9e184d', 'volume_name': 'volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf36d35-8739-40a3-a1ad-c41bc945128c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf36d35-8739-40a3-a1ad-c41bc945128c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a480dcb-f360-44a6-bc6f-b00e8858ec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:29 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Volume 689f3689-a0a1-4f34-9ad1-79ad6d9e184d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d', 'volume_size': 1} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1050751316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689f3689-a0a1-4f34-9ad1-79ad6d9e184d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169d6683729543d0b687e2a0b671d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:34:29Z,use_quota=True,user_id='7cfce396b5c7483c8110b8769d2b8889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Creating volume 689f3689-a0a1-4f34-9ad1-79ad6d9e184d {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:34:29 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:29 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d 1073741824 Apr 16 13:34:29 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:29 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d 1073741824" returned: 0 in 0.440s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:29 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d Apr 16 13:34:29 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:30 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d" returned: 0 in 0.405s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:34:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a480dcb-f360-44a6-bc6f-b00e8858ec29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8276e2-1022-45cd-856b-9d67edcf79ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:30 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Volume volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d (689f3689-a0a1-4f34-9ad1-79ad6d9e184d): created successfully Apr 16 13:34:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8276e2-1022-45cd-856b-9d67edcf79ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:30 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Flow 'volume_create_manager' (7c2c95e6-eda1-45a4-8f2d-0858ad813eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:34:30 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-59644cdc-3ce1-434f-8fb8-35b4439d995b tempest-VolumeDependencyTests-680584001 None] Created volume successfully. Apr 16 13:34:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:30 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] Creating offline snapshot 2dc94ae0-b9df-42f6-a879-872be46f8dc5 of volume 689f3689-a0a1-4f34-9ad1-79ad6d9e184d {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:34:30 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[de45b775-9f50-4111-b02c-9779312f56df]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:30 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d Apr 16 13:34:30 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:30 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d" returned: 0 in 0.461s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:30 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5 1G Apr 16 13:34:30 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:31 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5 1G" returned: 0 in 0.443s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:31 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5 Apr 16 13:34:31 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:31 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5" returned: 0 in 0.405s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:31 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5 is being set with open permissions: ugo+rw Apr 16 13:34:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:31 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5 Apr 16 13:34:31 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:32 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5" returned: 0 in 0.392s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:32 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.info Apr 16 13:34:32 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:32 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.info" returned: 0 in 0.389s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:32 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.info is being set with open permissions: ugo+rw Apr 16 13:34:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:32 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.info Apr 16 13:34:32 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:32 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.info" returned: 0 in 0.392s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.531s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:32 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-cde07438-1215-432f-816f-29fce3ccc25d tempest-VolumeDependencyTests-680584001 None] Create snapshot completed successfully Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Flow 'volume_create_manager' (24421644-860c-4205-8f9b-80b74c2a0f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d569e428-fb7f-42f2-9061-a0b4fd26395c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d569e428-fb7f-42f2-9061-a0b4fd26395c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1747652830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67670d8-bc55-4d62-bf12-cd3fe8c35111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169d6683729543d0b687e2a0b671d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2dc94ae0-b9df-42f6-a879-872be46f8dc5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:34:34Z,use_quota=True,user_id='7cfce396b5c7483c8110b8769d2b8889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81b288f-5246-4889-a6ff-e1286de57ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81b288f-5246-4889-a6ff-e1286de57ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcba4ce4-a231-4c35-8830-f79b7f4a80cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcba4ce4-a231-4c35-8830-f79b7f4a80cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e67670d8-bc55-4d62-bf12-cd3fe8c35111', 'volume_name': 'volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111', 'volume_size': 1, 'snapshot_id': '2dc94ae0-b9df-42f6-a879-872be46f8dc5'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2334d9f-05ab-4bcb-a021-00868aa2ff15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2334d9f-05ab-4bcb-a021-00868aa2ff15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3183618a-8bff-4a8a-b4a2-39c8e45e7583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:33 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Volume e67670d8-bc55-4d62-bf12-cd3fe8c35111: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111', 'volume_size': 1, 'snapshot_id': '2dc94ae0-b9df-42f6-a879-872be46f8dc5'} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Acquiring lock "cinder-quobyte-2dc94ae0-b9df-42f6-a879-872be46f8dc5-e67670d8-bc55-4d62-bf12-cd3fe8c35111" by "_create_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-2dc94ae0-b9df-42f6-a879-872be46f8dc5-e67670d8-bc55-4d62-bf12-cd3fe8c35111" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Creating volume e67670d8-bc55-4d62-bf12-cd3fe8c35111 from snapshot 2dc94ae0-b9df-42f6-a879-872be46f8dc5 {{(pid=83606) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Acquiring lock "cinder-quobyte-e67670d8-bc55-4d62-bf12-cd3fe8c35111" by "_copy_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-e67670d8-bc55-4d62-bf12-cd3fe8c35111" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] snapshot: 2dc94ae0-b9df-42f6-a879-872be46f8dc5, volume: e67670d8-bc55-4d62-bf12-cd3fe8c35111, {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca6ba95-31f8-4b63-841e-57edbb6b0d60]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:33 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5 Apr 16 13:34:33 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:34 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5" returned: 0 in 0.449s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Creating direct copy from snapshot {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a088a42-7061-4bb7-b1b3-7d4cc3e7d2b4]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:34 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d Apr 16 13:34:34 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG oslo_service.periodic_task [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83606) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:34 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:34:34 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:34 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d" returned: 0 in 0.490s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG cinder.utils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Path /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111 not found in is_blk_device check {{(pid=83606) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:34 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111 Apr 16 13:34:34 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:34 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.426s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:34 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:34:36 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111" returned: 0 in 1.740s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:36 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50da449-663a-4489-a033-f034ba869f77]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:36 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d Apr 16 13:34:36 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:37 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d" returned: 0 in 0.565s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:37 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Image conversion details: src /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d, size 1024.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111 {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:34:37 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Converted 1024.00 MB image at 587.91 MB/s Apr 16 13:34:37 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111 is being set with open permissions: ugo+rw Apr 16 13:34:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:37 devstack sudo[90799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111 Apr 16 13:34:37 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:37 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111" returned: 0 in 0.377s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-e67670d8-bc55-4d62-bf12-cd3fe8c35111" released by "_copy_volume_from_snapshot" :: held 3.672s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-2dc94ae0-b9df-42f6-a879-872be46f8dc5-e67670d8-bc55-4d62-bf12-cd3fe8c35111" released by "_create_volume_from_snapshot" :: held 3.686s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.693s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3183618a-8bff-4a8a-b4a2-39c8e45e7583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111', 'volume_size': 1, 'snapshot_id': '2dc94ae0-b9df-42f6-a879-872be46f8dc5'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be794ab7-4689-4c76-8bc5-721ede07b3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:37 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Volume volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111 (e67670d8-bc55-4d62-bf12-cd3fe8c35111): created successfully Apr 16 13:34:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be794ab7-4689-4c76-8bc5-721ede07b3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Flow 'volume_create_manager' (24421644-860c-4205-8f9b-80b74c2a0f7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:34:37 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-94dd9fac-c867-441c-bdcc-c673957573be tempest-VolumeDependencyTests-680584001 None] Created volume successfully. Apr 16 13:34:38 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] Acquiring lock "cinder-2dc94ae0-b9df-42f6-a879-872be46f8dc5-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:38 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] Lock "cinder-2dc94ae0-b9df-42f6-a879-872be46f8dc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:38 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] Acquiring lock "cinder-quobyte-689f3689-a0a1-4f34-9ad1-79ad6d9e184d" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:38 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-689f3689-a0a1-4f34-9ad1-79ad6d9e184d" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:38 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] Acquiring lock "cinder-quobyte-2dc94ae0-b9df-42f6-a879-872be46f8dc5" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:38 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-2dc94ae0-b9df-42f6-a879-872be46f8dc5" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:38 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] Deleting offline snapshot 2dc94ae0-b9df-42f6-a879-872be46f8dc5 of volume 689f3689-a0a1-4f34-9ad1-79ad6d9e184d {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:34:38 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] snapshot_file for this snap is: volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:34:38 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c6d64c-10fd-4729-84fb-56876db31fe8]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:38 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5 Apr 16 13:34:38 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:38 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5" returned: 0 in 0.449s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:38 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:34:38 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8427d814-c6a8-4309-bd50-5ecc90d873f4]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:38 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d Apr 16 13:34:38 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:39 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d" returned: 0 in 0.491s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:39 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5 Apr 16 13:34:39 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:39 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5" returned: 0 in 0.428s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:39 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5 Apr 16 13:34:39 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:39 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d.2dc94ae0-b9df-42f6-a879-872be46f8dc5" returned: 0 in 0.442s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:39 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-2dc94ae0-b9df-42f6-a879-872be46f8dc5" released by "_delete_snapshot" :: held 1.866s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:39 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-689f3689-a0a1-4f34-9ad1-79ad6d9e184d" released by "delete_snapshot" :: held 1.881s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:39 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] Created reservations ['11aa6a0f-49ed-4311-a9db-d9bdb38e3050', '957d74a1-4ebd-419b-bce7-a88fde854930', 'a540b34a-b23c-4000-a48e-bf975bacd933', 'fc237d53-f9b1-421b-841b-75d288f56c9c'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:34:40 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] Delete snapshot completed successfully. Apr 16 13:34:40 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a6328cec-418c-4e74-a4fe-e95ca04ed7ed tempest-VolumeDependencyTests-680584001 None] Lock "cinder-2dc94ae0-b9df-42f6-a879-872be46f8dc5-delete_snapshot" released by "delete_snapshot" :: held 1.953s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:40 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] Acquiring lock "cinder-689f3689-a0a1-4f34-9ad1-79ad6d9e184d-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:40 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] Lock "cinder-689f3689-a0a1-4f34-9ad1-79ad6d9e184d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:40 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] Acquiring lock "cinder-quobyte-689f3689-a0a1-4f34-9ad1-79ad6d9e184d" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:40 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-689f3689-a0a1-4f34-9ad1-79ad6d9e184d" acquired by "delete_volume" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:40 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2da433-a512-41e2-aa06-f3f99bd701a6]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:40 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d Apr 16 13:34:40 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:40 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d" returned: 0 in 0.448s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:40 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d Apr 16 13:34:40 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:41 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-689f3689-a0a1-4f34-9ad1-79ad6d9e184d" returned: 0 in 0.389s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-689f3689-a0a1-4f34-9ad1-79ad6d9e184d" released by "delete_volume" :: held 0.875s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] Created reservations ['27dac962-3b35-446b-b370-9e8b34df6eb4', '245bfcbf-e859-4c70-ad3a-549d9d447d3b', '6065054c-4440-4a5a-b59b-f87fbfbaa6e8', 'f194f607-17c7-4bcc-940e-426e6db8f8e0'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:41 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:34:41 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Flow 'volume_create_manager' (4186fdaf-08f1-4029-b33b-b37929203c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4884365a-eb02-4a77-bfda-f6dd14ffd43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4884365a-eb02-4a77-bfda-f6dd14ffd43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-658438361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a505c904-6d6b-4e17-8d09-e0a72f67d298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169d6683729543d0b687e2a0b671d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:34:42Z,use_quota=True,user_id='7cfce396b5c7483c8110b8769d2b8889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:41 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd79560-0ae2-4d0a-9bf9-693eec6acce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd79560-0ae2-4d0a-9bf9-693eec6acce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520f5d55-59f0-4fc1-ac5a-503d0802a1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520f5d55-59f0-4fc1-ac5a-503d0802a1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a505c904-6d6b-4e17-8d09-e0a72f67d298', 'volume_name': 'volume-a505c904-6d6b-4e17-8d09-e0a72f67d298', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f6d5d1-1fbc-4f7c-b08f-7ec679a16839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f6d5d1-1fbc-4f7c-b08f-7ec679a16839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c686b4-8ff6-4a09-99b7-d1d4404ad6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:41 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Volume a505c904-6d6b-4e17-8d09-e0a72f67d298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a505c904-6d6b-4e17-8d09-e0a72f67d298', 'volume_size': 1} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-658438361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a505c904-6d6b-4e17-8d09-e0a72f67d298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169d6683729543d0b687e2a0b671d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:34:42Z,use_quota=True,user_id='7cfce396b5c7483c8110b8769d2b8889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Creating volume a505c904-6d6b-4e17-8d09-e0a72f67d298 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:34:41 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.469s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:34:41 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] Deleted volume successfully. Apr 16 13:34:41 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 1073741824 Apr 16 13:34:41 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:41 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-fa3232d8-dcd9-4773-82b4-63e9eac71e63 tempest-VolumeDependencyTests-680584001 None] Lock "cinder-689f3689-a0a1-4f34-9ad1-79ad6d9e184d-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:42 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 1073741824" returned: 0 in 0.453s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:42 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 Apr 16 13:34:42 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:42 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298" returned: 0 in 0.396s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c686b4-8ff6-4a09-99b7-d1d4404ad6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a505c904-6d6b-4e17-8d09-e0a72f67d298', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f9eec6-f2be-430f-a86f-bce54f7881bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:42 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Volume volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 (a505c904-6d6b-4e17-8d09-e0a72f67d298): created successfully Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f9eec6-f2be-430f-a86f-bce54f7881bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Flow 'volume_create_manager' (4186fdaf-08f1-4029-b33b-b37929203c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:34:42 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-f1f096dd-781f-410f-9896-e2ead8705614 tempest-VolumeDependencyTests-680584001 None] Created volume successfully. Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Flow 'volume_create_manager' (615d08a4-93ac-4444-91c3-22ef66d0fb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de31f81f-dec2-4820-8f59-dd901371cbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de31f81f-dec2-4820-8f59-dd901371cbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-250871174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169d6683729543d0b687e2a0b671d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a505c904-6d6b-4e17-8d09-e0a72f67d298,status='creating',terminated_at=None,updated_at=2026-04-16T11:34:43Z,use_quota=True,user_id='7cfce396b5c7483c8110b8769d2b8889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5dca676-3722-4ad9-a1fb-5269544ef4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5dca676-3722-4ad9-a1fb-5269544ef4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e409297-9b8c-4151-92fc-ff12bdb69c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e409297-9b8c-4151-92fc-ff12bdb69c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e', 'volume_name': 'volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e', 'volume_size': 1, 'source_volid': 'a505c904-6d6b-4e17-8d09-e0a72f67d298', 'source_volstatus': 'available'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0611002c-0310-4639-9775-2a15ae100967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0611002c-0310-4639-9775-2a15ae100967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbee1c6b-3829-4682-adb5-7e2cb9fff736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:42 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Volume 3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e', 'volume_size': 1, 'source_volid': 'a505c904-6d6b-4e17-8d09-e0a72f67d298', 'source_volstatus': 'available'} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:42 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Cloning volume a505c904-6d6b-4e17-8d09-e0a72f67d298 to volume 3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Creating offline snapshot 45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f of volume a505c904-6d6b-4e17-8d09-e0a72f67d298 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9793f5-4139-4eb1-aaa9-9c46677649c2]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:42 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 Apr 16 13:34:42 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:43 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298" returned: 0 in 0.455s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:43 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f 1G Apr 16 13:34:43 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:43 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f 1G" returned: 0 in 0.452s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:43 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f Apr 16 13:34:43 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:44 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f" returned: 0 in 0.406s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:44 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f is being set with open permissions: ugo+rw Apr 16 13:34:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:44 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f Apr 16 13:34:44 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:44 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f" returned: 0 in 0.379s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:44 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.info Apr 16 13:34:44 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:45 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.info" returned: 0 in 0.405s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:45 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.info is being set with open permissions: ugo+rw Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:45 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.info Apr 16 13:34:45 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:45 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.info" returned: 0 in 0.395s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Acquiring lock "cinder-quobyte-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e" by "_copy_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] snapshot: 45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f, volume: 3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e, {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc9366c-8a08-4175-9c1a-cf91a91e063e]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:45 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f Apr 16 13:34:45 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:45 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f" returned: 0 in 0.464s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a505c904-6d6b-4e17-8d09-e0a72f67d298(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Creating direct copy from snapshot {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee2f33f-79e6-4365-963e-a8665bddfebe]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:46 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 Apr 16 13:34:46 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:46 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298" returned: 0 in 0.450s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:46 devstack cinder-volume[83606]: DEBUG cinder.utils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Path /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e not found in is_blk_device check {{(pid=83606) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 13:34:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:46 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e Apr 16 13:34:46 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:48 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e" returned: 0 in 1.839s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:48 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[860a5677-f57f-4f60-8273-0de54f3fcb3a]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:48 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 Apr 16 13:34:48 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:48 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298" returned: 0 in 0.568s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:48 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Image conversion details: src /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298, size 1024.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:34:48 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Converted 1024.00 MB image at 556.47 MB/s Apr 16 13:34:48 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e is being set with open permissions: ugo+rw Apr 16 13:34:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:48 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e Apr 16 13:34:48 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:49 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e" returned: 0 in 0.400s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e" released by "_copy_volume_from_snapshot" :: held 3.763s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Acquiring lock "cinder-quobyte-45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Deleting offline snapshot 45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f of volume a505c904-6d6b-4e17-8d09-e0a72f67d298 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:34:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] snapshot_file for this snap is: volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:34:49 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ccfc2f-544f-4839-a8b8-ec227dcaf751]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:49 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f Apr 16 13:34:49 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:49 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f" returned: 0 in 0.452s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a505c904-6d6b-4e17-8d09-e0a72f67d298(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:34:49 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[459ba0d8-8461-413d-8da7-0a955008f75b]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:49 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 Apr 16 13:34:49 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:50 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298" returned: 0 in 0.456s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:50 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f Apr 16 13:34:50 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:50 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f" returned: 0 in 0.419s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:50 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f Apr 16 13:34:50 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:50 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298.45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f" returned: 0 in 0.406s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-45d582ff-3e0f-4f8d-92b0-cc6fa62c9e2f" released by "_delete_snapshot" :: held 1.775s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.134s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbee1c6b-3829-4682-adb5-7e2cb9fff736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e', 'volume_size': 1, 'source_volid': 'a505c904-6d6b-4e17-8d09-e0a72f67d298', 'source_volstatus': 'available'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3568ea-7c80-4cd5-8351-8c1bf36b2041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:34:51 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Volume volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e (3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e): created successfully Apr 16 13:34:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3568ea-7c80-4cd5-8351-8c1bf36b2041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:34:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Flow 'volume_create_manager' (615d08a4-93ac-4444-91c3-22ef66d0fb2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:34:51 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-20963793-207f-4342-b0a8-80fcd5b40c49 tempest-VolumeDependencyTests-680584001 None] Created volume successfully. Apr 16 13:34:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] Acquiring lock "cinder-a505c904-6d6b-4e17-8d09-e0a72f67d298-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] Lock "cinder-a505c904-6d6b-4e17-8d09-e0a72f67d298-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] Acquiring lock "cinder-quobyte-a505c904-6d6b-4e17-8d09-e0a72f67d298" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-a505c904-6d6b-4e17-8d09-e0a72f67d298" acquired by "delete_volume" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:51 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08511a6-464e-4adf-bdba-a9dac5cfe873]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:51 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 Apr 16 13:34:51 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:51 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298" returned: 0 in 0.449s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:51 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298 Apr 16 13:34:51 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:52 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-a505c904-6d6b-4e17-8d09-e0a72f67d298" returned: 0 in 0.386s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-a505c904-6d6b-4e17-8d09-e0a72f67d298" released by "delete_volume" :: held 0.866s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] Created reservations ['1a3acae6-8658-4b69-92e5-ddbd9995358f', 'd3726301-1d94-4945-8859-a786bb1d7136', '5db62755-ceca-4457-a969-999282ecec17', 'f09440d2-e299-46fe-96ce-ed22d7ce38c8'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:52 devstack sudo[90921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:34:52 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] Acquiring lock "cinder-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] Lock "cinder-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] Acquiring lock "cinder-quobyte-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e" acquired by "delete_volume" :: waited 0.005s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[91608d18-4e64-48a4-9459-689eccffb60b]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:52 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e Apr 16 13:34:52 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:52 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.439s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:34:52 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] Deleted volume successfully. Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1014fdd8-64f9-476e-b98e-972495420f17 tempest-VolumeDependencyTests-680584001 None] Lock "cinder-a505c904-6d6b-4e17-8d09-e0a72f67d298-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:52 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e" returned: 0 in 0.472s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:52 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e Apr 16 13:34:52 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:53 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e" returned: 0 in 0.394s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e" released by "delete_volume" :: held 0.896s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] Created reservations ['26a74bdd-05b5-49ba-afb9-3010ca7d10b1', 'bbd103cc-05ee-439d-b165-2e9b58303491', 'ebd686de-d765-4b69-940d-b7987cf565d0', 'eac36c26-2a68-4cf9-bfb7-5b1fb8337d8c'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:53 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:34:53 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] Acquiring lock "cinder-e67670d8-bc55-4d62-bf12-cd3fe8c35111-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] Lock "cinder-e67670d8-bc55-4d62-bf12-cd3fe8c35111-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] Acquiring lock "cinder-quobyte-e67670d8-bc55-4d62-bf12-cd3fe8c35111" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-e67670d8-bc55-4d62-bf12-cd3fe8c35111" acquired by "delete_volume" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e917be-4563-47af-8909-acb584672694]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:53 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111 Apr 16 13:34:53 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:53 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.436s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:34:53 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] Deleted volume successfully. Apr 16 13:34:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5aae0403-4520-4a9d-89bd-fbd4864662bf tempest-VolumeDependencyTests-680584001 None] Lock "cinder-3d3294c6-9bb1-4b35-83c6-50b6c5aa2c9e-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:54 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111" returned: 0 in 0.464s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:54 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111 Apr 16 13:34:54 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:54 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e67670d8-bc55-4d62-bf12-cd3fe8c35111" returned: 0 in 0.391s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] Lock "cinder-quobyte-e67670d8-bc55-4d62-bf12-cd3fe8c35111" released by "delete_volume" :: held 0.877s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:34:54 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] Created reservations ['0ac47cde-ceec-4364-b494-723cd059720f', '1c5d8bf4-9f40-4a53-841e-4bb9024c8720', '6e2d2836-72c8-46b4-9869-707012c1a3c9', '77047007-c678-4976-9526-237042cd3d8b'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:34:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:34:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:34:54 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:34:54 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:34:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:34:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:34:54 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:34:54 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:34:55 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Apr 16 13:34:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.455s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:34:55 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:34:55 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] Deleted volume successfully. Apr 16 13:34:55 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-4f2c2220-2245-49bb-b1ef-3accd3787c54 tempest-VolumeDependencyTests-680584001 None] Lock "cinder-e67670d8-bc55-4d62-bf12-cd3fe8c35111-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:04 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:UPDATE=73,cinder:SELECT=58,cinder:INSERT=16,cinder:DELETE=2 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:35:05 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:SELECT=82,cinder:INSERT=32,cinder:UPDATE=101,cinder:DELETE=11 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Flow 'volume_create_manager' (e5e67e0d-de8e-4c05-914a-fadf366460be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb79cac-9426-4357-9664-dafa5af3cd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb79cac-9426-4357-9664-dafa5af3cd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-519654105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a891dd-11ec-48f3-83a9-0d3abbd0f359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bd6ce066a9459eaaf94ad96a58f9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:11Z,use_quota=True,user_id='cb4b4c1546a8413499a4a53f3475a49f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da0f7404-0617-4f62-ad6d-58be38d1b299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da0f7404-0617-4f62-ad6d-58be38d1b299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e45dae9-b501-48d0-a639-7c6a604f80da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e45dae9-b501-48d0-a639-7c6a604f80da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a891dd-11ec-48f3-83a9-0d3abbd0f359', 'volume_name': 'volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022f7c27-e713-4cec-b105-40a1a7156215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022f7c27-e713-4cec-b105-40a1a7156215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9173d14d-0c1f-4eb6-84a2-828f33ae5770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:10 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Volume 89a891dd-11ec-48f3-83a9-0d3abbd0f359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359', 'volume_size': 1} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-519654105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a891dd-11ec-48f3-83a9-0d3abbd0f359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bd6ce066a9459eaaf94ad96a58f9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:11Z,use_quota=True,user_id='cb4b4c1546a8413499a4a53f3475a49f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Creating volume 89a891dd-11ec-48f3-83a9-0d3abbd0f359 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:35:10 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:35:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:10 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 1073741824 Apr 16 13:35:10 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:11 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 1073741824" returned: 0 in 0.458s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:11 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 Apr 16 13:35:11 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:11 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359" returned: 0 in 0.392s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:11 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:35:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:11 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9173d14d-0c1f-4eb6-84a2-828f33ae5770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:11 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cde9419-6b4e-42ef-86d2-07f076093c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:11 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Volume volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 (89a891dd-11ec-48f3-83a9-0d3abbd0f359): created successfully Apr 16 13:35:11 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cde9419-6b4e-42ef-86d2-07f076093c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:11 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Flow 'volume_create_manager' (e5e67e0d-de8e-4c05-914a-fadf366460be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:11 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-f0fedbd2-2d30-495b-a8c3-ffc607d87aba tempest-SnapshotDependencyTests-1594263754 None] Created volume successfully. Apr 16 13:35:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:12 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] Creating offline snapshot b8d37d58-f226-4995-811c-665fed1cc689 of volume 89a891dd-11ec-48f3-83a9-0d3abbd0f359 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:35:12 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f044808f-bf29-43ef-aba1-432be3061f96]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:12 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 Apr 16 13:35:12 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:12 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359" returned: 0 in 0.440s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:12 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689 1G Apr 16 13:35:12 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:12 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689 1G" returned: 0 in 0.451s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:12 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689 Apr 16 13:35:12 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:13 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689" returned: 0 in 0.410s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:13 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689 is being set with open permissions: ugo+rw Apr 16 13:35:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:13 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689 Apr 16 13:35:13 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:13 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689" returned: 0 in 0.394s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:13 devstack sudo[91018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.info Apr 16 13:35:13 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:14 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.info" returned: 0 in 0.412s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:14 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.info is being set with open permissions: ugo+rw Apr 16 13:35:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:14 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.info Apr 16 13:35:14 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:14 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.info" returned: 0 in 0.382s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.544s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:14 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d038159c-2c78-4594-b079-2f2a711b883c tempest-SnapshotDependencyTests-1594263754 None] Create snapshot completed successfully Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Flow 'volume_create_manager' (9667d92f-77fc-4245-bb7d-f70a123812e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2097b09a-4dfb-49ef-9355-37d453b6a47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2097b09a-4dfb-49ef-9355-37d453b6a47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d405769-8d30-401f-9494-5ab34d7b7e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bd6ce066a9459eaaf94ad96a58f9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b8d37d58-f226-4995-811c-665fed1cc689,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:15Z,use_quota=True,user_id='cb4b4c1546a8413499a4a53f3475a49f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea5b75b-ff65-4d18-b296-a346058c3c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea5b75b-ff65-4d18-b296-a346058c3c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28e8421-b849-4fcc-ba97-0827ebd2fcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28e8421-b849-4fcc-ba97-0827ebd2fcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d405769-8d30-401f-9494-5ab34d7b7e89', 'volume_name': 'volume-2d405769-8d30-401f-9494-5ab34d7b7e89', 'volume_size': 1, 'snapshot_id': 'b8d37d58-f226-4995-811c-665fed1cc689'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4ab1b7-d473-462f-8bc3-8e67098146e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4ab1b7-d473-462f-8bc3-8e67098146e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed4e021-b52d-49fe-b9d9-f865223bf32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:15 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Volume 2d405769-8d30-401f-9494-5ab34d7b7e89: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d405769-8d30-401f-9494-5ab34d7b7e89', 'volume_size': 1, 'snapshot_id': 'b8d37d58-f226-4995-811c-665fed1cc689'} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Acquiring lock "cinder-quobyte-b8d37d58-f226-4995-811c-665fed1cc689-2d405769-8d30-401f-9494-5ab34d7b7e89" by "_create_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-quobyte-b8d37d58-f226-4995-811c-665fed1cc689-2d405769-8d30-401f-9494-5ab34d7b7e89" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Creating volume 2d405769-8d30-401f-9494-5ab34d7b7e89 from snapshot b8d37d58-f226-4995-811c-665fed1cc689 {{(pid=83606) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Acquiring lock "cinder-quobyte-2d405769-8d30-401f-9494-5ab34d7b7e89" by "_copy_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-quobyte-2d405769-8d30-401f-9494-5ab34d7b7e89" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] snapshot: b8d37d58-f226-4995-811c-665fed1cc689, volume: 2d405769-8d30-401f-9494-5ab34d7b7e89, {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a0d265-7c22-4270-93f2-5708f98e3dd0]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:15 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689 Apr 16 13:35:15 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:16 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689" returned: 0 in 0.496s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:16 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:35:16 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 13:35:16 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Creating direct copy from snapshot {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 13:35:16 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc190d06-39a1-413d-8634-c39b4a60dbd4]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:16 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 Apr 16 13:35:16 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:16 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359" returned: 0 in 0.467s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:16 devstack cinder-volume[83606]: DEBUG cinder.utils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Path /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d405769-8d30-401f-9494-5ab34d7b7e89 not found in is_blk_device check {{(pid=83606) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 13:35:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d405769-8d30-401f-9494-5ab34d7b7e89 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:16 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d405769-8d30-401f-9494-5ab34d7b7e89 Apr 16 13:35:16 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:18 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d405769-8d30-401f-9494-5ab34d7b7e89" returned: 0 in 1.834s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:18 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32988b6-fa99-4ce9-a0f4-c13531a2090a]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:18 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 Apr 16 13:35:18 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:18 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359" returned: 0 in 0.572s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:18 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Image conversion details: src /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359, size 1024.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d405769-8d30-401f-9494-5ab34d7b7e89 {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:35:18 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Converted 1024.00 MB image at 558.03 MB/s Apr 16 13:35:18 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d405769-8d30-401f-9494-5ab34d7b7e89 is being set with open permissions: ugo+rw Apr 16 13:35:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d405769-8d30-401f-9494-5ab34d7b7e89 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:18 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d405769-8d30-401f-9494-5ab34d7b7e89 Apr 16 13:35:18 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:19 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d405769-8d30-401f-9494-5ab34d7b7e89" returned: 0 in 0.395s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-quobyte-2d405769-8d30-401f-9494-5ab34d7b7e89" released by "_copy_volume_from_snapshot" :: held 3.816s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-quobyte-b8d37d58-f226-4995-811c-665fed1cc689-2d405769-8d30-401f-9494-5ab34d7b7e89" released by "_create_volume_from_snapshot" :: held 3.831s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.840s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed4e021-b52d-49fe-b9d9-f865223bf32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d405769-8d30-401f-9494-5ab34d7b7e89', 'volume_size': 1, 'snapshot_id': 'b8d37d58-f226-4995-811c-665fed1cc689'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb70153-4ed2-4510-801b-2560c38a354d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:19 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Volume volume-2d405769-8d30-401f-9494-5ab34d7b7e89 (2d405769-8d30-401f-9494-5ab34d7b7e89): created successfully Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb70153-4ed2-4510-801b-2560c38a354d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Flow 'volume_create_manager' (9667d92f-77fc-4245-bb7d-f70a123812e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:19 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-e33e716b-b424-4f29-bb20-3ada08b011e1 tempest-SnapshotDependencyTests-1594263754 None] Created volume successfully. Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] Acquiring lock "cinder-b8d37d58-f226-4995-811c-665fed1cc689-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-b8d37d58-f226-4995-811c-665fed1cc689-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] Acquiring lock "cinder-quobyte-89a891dd-11ec-48f3-83a9-0d3abbd0f359" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-quobyte-89a891dd-11ec-48f3-83a9-0d3abbd0f359" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] Acquiring lock "cinder-quobyte-b8d37d58-f226-4995-811c-665fed1cc689" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-quobyte-b8d37d58-f226-4995-811c-665fed1cc689" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] Deleting offline snapshot b8d37d58-f226-4995-811c-665fed1cc689 of volume 89a891dd-11ec-48f3-83a9-0d3abbd0f359 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] snapshot_file for this snap is: volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d283acec-2e8d-4fb7-9502-51cc5b75b59b]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:19 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689 Apr 16 13:35:19 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:20 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689" returned: 0 in 0.453s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:35:20 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e89d89-60eb-47fc-87b2-3c08d0808fd8]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:20 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 Apr 16 13:35:20 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:20 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359" returned: 0 in 0.453s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:20 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689 Apr 16 13:35:20 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:21 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689" returned: 0 in 0.437s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:21 devstack sudo[91069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689 Apr 16 13:35:21 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:21 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359.b8d37d58-f226-4995-811c-665fed1cc689" returned: 0 in 0.391s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-quobyte-b8d37d58-f226-4995-811c-665fed1cc689" released by "_delete_snapshot" :: held 1.786s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-quobyte-89a891dd-11ec-48f3-83a9-0d3abbd0f359" released by "delete_snapshot" :: held 1.797s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:21 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] Created reservations ['219e90f7-db07-4488-82a2-c6810556e20e', '3817f8e3-3050-4a76-a434-b82ca8803c67', '776acef3-cd41-4f60-9956-9e672785afad', '145ba9dc-d0fe-4bbd-b7fc-88f6fba5f31c'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:35:21 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] Delete snapshot completed successfully. Apr 16 13:35:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d9e30639-785d-4968-909c-e6d05965b0b2 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-b8d37d58-f226-4995-811c-665fed1cc689-delete_snapshot" released by "delete_snapshot" :: held 1.876s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] Acquiring lock "cinder-89a891dd-11ec-48f3-83a9-0d3abbd0f359-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-89a891dd-11ec-48f3-83a9-0d3abbd0f359-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] Acquiring lock "cinder-quobyte-89a891dd-11ec-48f3-83a9-0d3abbd0f359" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-quobyte-89a891dd-11ec-48f3-83a9-0d3abbd0f359" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:21 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[22566567-7281-442e-ae51-33e4f20f83bd]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:21 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 Apr 16 13:35:21 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:22 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359" returned: 0 in 0.443s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:22 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359 Apr 16 13:35:22 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:22 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-89a891dd-11ec-48f3-83a9-0d3abbd0f359" returned: 0 in 0.406s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-quobyte-89a891dd-11ec-48f3-83a9-0d3abbd0f359" released by "delete_volume" :: held 0.884s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:22 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] Created reservations ['ed208e3b-5ced-4cde-a595-a6c4b6526208', '7a76f393-9a6a-45e6-abbd-93b85185143f', '5c756b70-ad13-41c7-858b-f314080e90e6', '37f58197-b2ef-46ec-aa5d-8cf97d8f2aae'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:35:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:22 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:35:22 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] Acquiring lock "cinder-2d405769-8d30-401f-9494-5ab34d7b7e89-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-2d405769-8d30-401f-9494-5ab34d7b7e89-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] Acquiring lock "cinder-quobyte-2d405769-8d30-401f-9494-5ab34d7b7e89" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-quobyte-2d405769-8d30-401f-9494-5ab34d7b7e89" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:23 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b523c6-daeb-4aff-abda-41086887d268]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d405769-8d30-401f-9494-5ab34d7b7e89 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:23 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d405769-8d30-401f-9494-5ab34d7b7e89 Apr 16 13:35:23 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:23 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.411s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:23 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:35:23 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] Deleted volume successfully. Apr 16 13:35:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a90ecdd7-36e3-4dcb-9c7b-4ce8009727a7 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-89a891dd-11ec-48f3-83a9-0d3abbd0f359-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:23 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d405769-8d30-401f-9494-5ab34d7b7e89" returned: 0 in 0.467s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d405769-8d30-401f-9494-5ab34d7b7e89 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:23 devstack sudo[91088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d405769-8d30-401f-9494-5ab34d7b7e89 Apr 16 13:35:23 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:23 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d405769-8d30-401f-9494-5ab34d7b7e89" returned: 0 in 0.409s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-quobyte-2d405769-8d30-401f-9494-5ab34d7b7e89" released by "delete_volume" :: held 0.896s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:23 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] Created reservations ['a4ea263c-efc9-4257-942b-674a395ccb22', '22781245-f18d-4c09-8adb-b42e9ad6abc9', '51812a50-11f9-4ece-b74a-a7cfccc50f01', '2c4470e3-16fa-421c-8960-ca530aa8c9e0'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:35:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:23 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:23 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:23 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:35:23 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:24 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.427s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:24 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:35:24 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] Deleted volume successfully. Apr 16 13:35:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-62243bd2-d890-4654-930f-776bce7c21f4 tempest-SnapshotDependencyTests-1594263754 None] Lock "cinder-2d405769-8d30-401f-9494-5ab34d7b7e89-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:34 devstack cinder-volume[83606]: DEBUG oslo_service.periodic_task [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83606) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 13:35:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:34 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:35:34 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:35 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.528s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:35 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:35:35 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Flow 'volume_create_manager' (dd6fd67a-6c91-4571-a945-0ccd33607043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1057196-1816-44c9-a75a-a945e5ac184c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1057196-1816-44c9-a75a-a945e5ac184c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868863a0-4c19-4c03-9d0b-0fb94007213f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5474123c2ed14824a3ab32f5dddea5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:36Z,use_quota=True,user_id='e247bd44665a4f1a8bf52d025c9506c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7855b863-195e-4402-aa63-85d44a2197fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7855b863-195e-4402-aa63-85d44a2197fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:35 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa570b60-0459-4fe4-b706-8ce9a4ea6ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa570b60-0459-4fe4-b706-8ce9a4ea6ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '868863a0-4c19-4c03-9d0b-0fb94007213f', 'volume_name': 'volume-868863a0-4c19-4c03-9d0b-0fb94007213f', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d07ecc3-9ccb-4f03-9a5d-d752aaf87cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d07ecc3-9ccb-4f03-9a5d-d752aaf87cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c56bbb20-f6a7-42ba-b795-f25cdedfc2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Volume 868863a0-4c19-4c03-9d0b-0fb94007213f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-868863a0-4c19-4c03-9d0b-0fb94007213f', 'volume_size': 1} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868863a0-4c19-4c03-9d0b-0fb94007213f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5474123c2ed14824a3ab32f5dddea5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:36Z,use_quota=True,user_id='e247bd44665a4f1a8bf52d025c9506c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Creating volume 868863a0-4c19-4c03-9d0b-0fb94007213f {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:35:36 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-868863a0-4c19-4c03-9d0b-0fb94007213f 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:36 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-868863a0-4c19-4c03-9d0b-0fb94007213f 1073741824 Apr 16 13:35:36 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Flow 'volume_create_manager' (24df36dc-03c8-4303-b183-a3674c83da87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99cab892-4e40-4aae-9aee-cd50cf2dece7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99cab892-4e40-4aae-9aee-cd50cf2dece7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1224309293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969ed7c0-59b2-4f1d-8975-f70a1dda82a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0134b50d4c44bfdbf468ca7409a88ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:36Z,use_quota=True,user_id='e72081a71d1942b1b8e2cac7c5a20635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8e1489-cb6d-4141-8199-cec634089f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8e1489-cb6d-4141-8199-cec634089f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b78410-5d2a-4ff8-b73c-532209075da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b78410-5d2a-4ff8-b73c-532209075da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '969ed7c0-59b2-4f1d-8975-f70a1dda82a7', 'volume_name': 'volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525e88ae-1778-40e6-bf6d-8b22474f8c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525e88ae-1778-40e6-bf6d-8b22474f8c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b6c88c-f23f-40ec-b848-daac062e2347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Volume 969ed7c0-59b2-4f1d-8975-f70a1dda82a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7', 'volume_size': 1} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Flow 'volume_create_manager' (13abfde6-4290-4fd0-80c9-62a65871d5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d7ed4a-0c55-4d9f-99f8-d8e2e7b64f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d7ed4a-0c55-4d9f-99f8-d8e2e7b64f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1993052599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6049fa79-1a2c-4d65-84d1-92536d0a425c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cb7244b8894186a250286eb0f93cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:36Z,use_quota=True,user_id='17770b9b5f6f4c46be660d5b98ec3130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca79d5e-3466-46a5-b0b7-f368b4bd2137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca79d5e-3466-46a5-b0b7-f368b4bd2137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8878e465-7dcf-489f-8485-11361c6a0f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8878e465-7dcf-489f-8485-11361c6a0f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6049fa79-1a2c-4d65-84d1-92536d0a425c', 'volume_name': 'volume-6049fa79-1a2c-4d65-84d1-92536d0a425c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7f71e7-6437-4a62-ab60-71ce91ecd596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7f71e7-6437-4a62-ab60-71ce91ecd596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a4c88d-7c73-4032-ae69-2561103fa793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Volume 6049fa79-1a2c-4d65-84d1-92536d0a425c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6049fa79-1a2c-4d65-84d1-92536d0a425c', 'volume_size': 1} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Flow 'volume_create_manager' (4ec6a8f6-42c2-451c-afae-da5793957fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5520e7b-3718-4cbb-8c18-a5a737216406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5520e7b-3718-4cbb-8c18-a5a737216406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-130144893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70363f4f-f18f-4863-b969-9fe13c4496b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4af35a4037f48cdb6b350775b2c0062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:36Z,use_quota=True,user_id='728469aae73c4c1195a98ff53e4891d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fe947f-3316-4611-9703-4df9ff375db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fe947f-3316-4611-9703-4df9ff375db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c669065-1f27-465b-afac-dfbfd6c85fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c669065-1f27-465b-afac-dfbfd6c85fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70363f4f-f18f-4863-b969-9fe13c4496b0', 'volume_name': 'volume-70363f4f-f18f-4863-b969-9fe13c4496b0', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82896a38-7a25-4c75-bd97-91ee9ced3a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82896a38-7a25-4c75-bd97-91ee9ced3a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4c10e5-9acf-47ce-974d-124652370544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume 70363f4f-f18f-4863-b969-9fe13c4496b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70363f4f-f18f-4863-b969-9fe13c4496b0', 'volume_size': 1} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Flow 'volume_create_manager' (81e52677-2eca-4623-bed7-d567088afba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac74b16-bc96-4270-be33-f430abf720f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac74b16-bc96-4270-be33-f430abf720f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-696999253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cb7244b8894186a250286eb0f93cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:36Z,use_quota=True,user_id='17770b9b5f6f4c46be660d5b98ec3130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f8aa69-5170-4b51-a97f-fa4048c03878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f8aa69-5170-4b51-a97f-fa4048c03878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49dfc61f-8d2f-4b27-82da-9c2c4a6a6a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49dfc61f-8d2f-4b27-82da-9c2c4a6a6a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b', 'volume_name': 'volume-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5b6c0f-dab1-41bb-a372-d4311250674b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5b6c0f-dab1-41bb-a372-d4311250674b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1f57ce-a207-4fa4-adcd-ad28a472d533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Volume c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b', 'volume_size': 1} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:36 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-868863a0-4c19-4c03-9d0b-0fb94007213f 1073741824" returned: 0 in 0.607s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-868863a0-4c19-4c03-9d0b-0fb94007213f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:36 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-868863a0-4c19-4c03-9d0b-0fb94007213f Apr 16 13:35:36 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Flow 'volume_create_manager' (c5bfec00-569a-432f-a908-77f490fc3732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ce6a19-a646-4076-a3b1-5e4bfd27e02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ce6a19-a646-4076-a3b1-5e4bfd27e02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1016953522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761ecb4e-5895-4095-92ca-181a19f7a36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cb7244b8894186a250286eb0f93cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:37Z,use_quota=True,user_id='17770b9b5f6f4c46be660d5b98ec3130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca21995-5dc4-40ca-8956-34563198091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca21995-5dc4-40ca-8956-34563198091f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f83d3b2-07c7-4233-b1f2-f6dfe501c98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f83d3b2-07c7-4233-b1f2-f6dfe501c98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '761ecb4e-5895-4095-92ca-181a19f7a36c', 'volume_name': 'volume-761ecb4e-5895-4095-92ca-181a19f7a36c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd9c713-4f28-4b10-969e-32eeac0058d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd9c713-4f28-4b10-969e-32eeac0058d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fd32f5-e9c1-494d-a1c7-47c0fe2b15cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Volume 761ecb4e-5895-4095-92ca-181a19f7a36c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-761ecb4e-5895-4095-92ca-181a19f7a36c', 'volume_size': 1} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Flow 'volume_create_manager' (ab890495-485e-45c0-bd55-69e770b6847a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35bcf4e-5b79-4186-987e-91af019d69c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35bcf4e-5b79-4186-987e-91af019d69c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1591181633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154d4fc7-3e30-43e6-a695-8e8f9b91c7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cb7244b8894186a250286eb0f93cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:37Z,use_quota=True,user_id='17770b9b5f6f4c46be660d5b98ec3130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ffd003-ad81-486a-9346-3c3c42d7075c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ffd003-ad81-486a-9346-3c3c42d7075c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51eb2dad-c094-4ee1-8e2f-7c08e36b96cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51eb2dad-c094-4ee1-8e2f-7c08e36b96cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '154d4fc7-3e30-43e6-a695-8e8f9b91c7c8', 'volume_name': 'volume-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d625069-42cd-4dcb-971b-a48daa9cca12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d625069-42cd-4dcb-971b-a48daa9cca12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1113c785-6782-4a11-b591-05552a3e22aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:36 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Volume 154d4fc7-3e30-43e6-a695-8e8f9b91c7c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8', 'volume_size': 1} Apr 16 13:35:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Flow 'volume_create_manager' (2ea96fca-1fef-4837-ad2e-73d1f8e9f999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6231c635-135f-443c-9537-0d4718300017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6231c635-135f-443c-9537-0d4718300017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1285972505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dec94c5-7b5e-4117-b188-f90734895118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cb7244b8894186a250286eb0f93cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:37Z,use_quota=True,user_id='17770b9b5f6f4c46be660d5b98ec3130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3887fcd-5aad-4a2f-9768-8d22a427bdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3887fcd-5aad-4a2f-9768-8d22a427bdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e14a52-0041-43d8-995a-e18f9f7a42d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e14a52-0041-43d8-995a-e18f9f7a42d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dec94c5-7b5e-4117-b188-f90734895118', 'volume_name': 'volume-6dec94c5-7b5e-4117-b188-f90734895118', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896de0dc-e34d-4ed0-848f-c61e4129b239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896de0dc-e34d-4ed0-848f-c61e4129b239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5818214f-19ba-4a10-8e0e-7e2cc6253a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:37 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Volume 6dec94c5-7b5e-4117-b188-f90734895118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dec94c5-7b5e-4117-b188-f90734895118', 'volume_size': 1} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:37 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-868863a0-4c19-4c03-9d0b-0fb94007213f" returned: 0 in 0.490s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.043s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1224309293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969ed7c0-59b2-4f1d-8975-f70a1dda82a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0134b50d4c44bfdbf468ca7409a88ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:36Z,use_quota=True,user_id='e72081a71d1942b1b8e2cac7c5a20635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Creating volume 969ed7c0-59b2-4f1d-8975-f70a1dda82a7 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:35:37 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c56bbb20-f6a7-42ba-b795-f25cdedfc2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-868863a0-4c19-4c03-9d0b-0fb94007213f', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da71bca5-dd31-4571-b3da-21dbb3e4f2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:37 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 1073741824 Apr 16 13:35:37 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:37 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Volume volume-868863a0-4c19-4c03-9d0b-0fb94007213f (868863a0-4c19-4c03-9d0b-0fb94007213f): created successfully Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da71bca5-dd31-4571-b3da-21dbb3e4f2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Flow 'volume_create_manager' (dd6fd67a-6c91-4571-a945-0ccd33607043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:37 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-9b264446-4483-458e-90a9-6041b79d12f4 tempest-CinderUnicodeTest-1943968668 None] Created volume successfully. Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Flow 'volume_create_manager' (11d63075-9d6c-44c2-a78a-24d548321bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9e227c-756f-43eb-8f5f-c74819dd9d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9e227c-756f-43eb-8f5f-c74819dd9d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-412248603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb925c2-eb75-42c5-960c-b511675549c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5474123c2ed14824a3ab32f5dddea5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:38Z,use_quota=True,user_id='e247bd44665a4f1a8bf52d025c9506c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7804dbd4-6126-40e6-8542-aba52f9e6715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7804dbd4-6126-40e6-8542-aba52f9e6715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de634194-fb82-4d09-aba0-9b1d7f49a4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de634194-fb82-4d09-aba0-9b1d7f49a4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffb925c2-eb75-42c5-960c-b511675549c1', 'volume_name': 'volume-ffb925c2-eb75-42c5-960c-b511675549c1', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1593de-6600-45f3-8755-bdc29985f598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1593de-6600-45f3-8755-bdc29985f598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9daa16ff-5649-4c38-9c24-10df3b956a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:37 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Volume ffb925c2-eb75-42c5-960c-b511675549c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffb925c2-eb75-42c5-960c-b511675549c1', 'volume_size': 1} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:37 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 1073741824" returned: 0 in 0.548s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:37 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 Apr 16 13:35:37 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:38 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7" returned: 0 in 0.434s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.896s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1993052599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6049fa79-1a2c-4d65-84d1-92536d0a425c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cb7244b8894186a250286eb0f93cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:36Z,use_quota=True,user_id='17770b9b5f6f4c46be660d5b98ec3130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Creating volume 6049fa79-1a2c-4d65-84d1-92536d0a425c {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:35:38 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6049fa79-1a2c-4d65-84d1-92536d0a425c 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b6c88c-f23f-40ec-b848-daac062e2347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0131d6-033c-4131-9e8b-a6fa7c56af5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:38 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6049fa79-1a2c-4d65-84d1-92536d0a425c 1073741824 Apr 16 13:35:38 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:38 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Volume volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 (969ed7c0-59b2-4f1d-8975-f70a1dda82a7): created successfully Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0131d6-033c-4131-9e8b-a6fa7c56af5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Flow 'volume_create_manager' (24df36dc-03c8-4303-b183-a3674c83da87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:38 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-8d894df9-39c4-4897-9536-3ed2cc5e4b0a tempest-VolumeDependencyTests-1512928148 None] Created volume successfully. Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:38 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6049fa79-1a2c-4d65-84d1-92536d0a425c 1073741824" returned: 0 in 0.525s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:38 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6049fa79-1a2c-4d65-84d1-92536d0a425c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:38 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6049fa79-1a2c-4d65-84d1-92536d0a425c Apr 16 13:35:38 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:39 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6049fa79-1a2c-4d65-84d1-92536d0a425c" returned: 0 in 0.397s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.691s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-130144893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70363f4f-f18f-4863-b969-9fe13c4496b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4af35a4037f48cdb6b350775b2c0062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:36Z,use_quota=True,user_id='728469aae73c4c1195a98ff53e4891d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Creating volume 70363f4f-f18f-4863-b969-9fe13c4496b0 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:35:39 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a4c88d-7c73-4032-ae69-2561103fa793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6049fa79-1a2c-4d65-84d1-92536d0a425c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e33757-e900-4316-b55b-dc3a32c4643e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:39 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0 1073741824 Apr 16 13:35:39 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:39 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Volume volume-6049fa79-1a2c-4d65-84d1-92536d0a425c (6049fa79-1a2c-4d65-84d1-92536d0a425c): created successfully Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e33757-e900-4316-b55b-dc3a32c4643e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Flow 'volume_create_manager' (13abfde6-4290-4fd0-80c9-62a65871d5f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:39 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-5499b727-e274-42dd-9cbf-c8784584ffc3 tempest-CreateVolumesFromImageTest-541632467 None] Created volume successfully. Apr 16 13:35:39 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0 1073741824" returned: 0 in 0.505s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:39 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:39 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0 Apr 16 13:35:39 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:40 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0" returned: 0 in 0.426s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.483s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-696999253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cb7244b8894186a250286eb0f93cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:36Z,use_quota=True,user_id='17770b9b5f6f4c46be660d5b98ec3130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Creating volume c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:35:40 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4c10e5-9acf-47ce-974d-124652370544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70363f4f-f18f-4863-b969-9fe13c4496b0', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:40 devstack sudo[91176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b 1073741824 Apr 16 13:35:40 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5b8ce9-f9dc-4c87-abee-194a92be77c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:40 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume volume-70363f4f-f18f-4863-b969-9fe13c4496b0 (70363f4f-f18f-4863-b969-9fe13c4496b0): created successfully Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5b8ce9-f9dc-4c87-abee-194a92be77c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Flow 'volume_create_manager' (4ec6a8f6-42c2-451c-afae-da5793957fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:40 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-ace10514-5cd0-45bd-a823-684f90a3ac55 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Created volume successfully. Apr 16 13:35:40 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b 1073741824" returned: 0 in 0.460s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:40 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b Apr 16 13:35:40 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:40 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:41 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b" returned: 0 in 0.449s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.242s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1016953522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761ecb4e-5895-4095-92ca-181a19f7a36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cb7244b8894186a250286eb0f93cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:37Z,use_quota=True,user_id='17770b9b5f6f4c46be660d5b98ec3130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Creating volume 761ecb4e-5895-4095-92ca-181a19f7a36c {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:35:41 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-761ecb4e-5895-4095-92ca-181a19f7a36c 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1f57ce-a207-4fa4-adcd-ad28a472d533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686a2d19-c32a-4e10-b38a-9a2e83a45028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:41 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-761ecb4e-5895-4095-92ca-181a19f7a36c 1073741824 Apr 16 13:35:41 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:41 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Volume volume-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b (c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b): created successfully Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686a2d19-c32a-4e10-b38a-9a2e83a45028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Flow 'volume_create_manager' (81e52677-2eca-4623-bed7-d567088afba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:41 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-05ac767b-d99a-439e-9d79-ab70f348e9b9 tempest-CreateVolumesFromImageTest-541632467 None] Created volume successfully. Apr 16 13:35:41 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-761ecb4e-5895-4095-92ca-181a19f7a36c 1073741824" returned: 0 in 0.461s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-761ecb4e-5895-4095-92ca-181a19f7a36c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:41 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-761ecb4e-5895-4095-92ca-181a19f7a36c Apr 16 13:35:41 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:41 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-761ecb4e-5895-4095-92ca-181a19f7a36c" returned: 0 in 0.406s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.015s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1591181633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154d4fc7-3e30-43e6-a695-8e8f9b91c7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cb7244b8894186a250286eb0f93cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:37Z,use_quota=True,user_id='17770b9b5f6f4c46be660d5b98ec3130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Creating volume 154d4fc7-3e30-43e6-a695-8e8f9b91c7c8 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:35:41 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fd32f5-e9c1-494d-a1c7-47c0fe2b15cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-761ecb4e-5895-4095-92ca-181a19f7a36c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8746b366-42c4-4fd4-803a-a208690cdb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:41 devstack sudo[91192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8 1073741824 Apr 16 13:35:41 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:41 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Volume volume-761ecb4e-5895-4095-92ca-181a19f7a36c (761ecb4e-5895-4095-92ca-181a19f7a36c): created successfully Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8746b366-42c4-4fd4-803a-a208690cdb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:41 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Flow 'volume_create_manager' (c5bfec00-569a-432f-a908-77f490fc3732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:41 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-0472a023-b388-4788-b330-9314c014b62a tempest-CreateVolumesFromImageTest-541632467 None] Created volume successfully. Apr 16 13:35:42 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8 1073741824" returned: 0 in 0.454s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:42 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8 Apr 16 13:35:42 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:42 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8" returned: 0 in 0.419s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.706s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1285972505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dec94c5-7b5e-4117-b188-f90734895118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cb7244b8894186a250286eb0f93cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:37Z,use_quota=True,user_id='17770b9b5f6f4c46be660d5b98ec3130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Creating volume 6dec94c5-7b5e-4117-b188-f90734895118 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:35:42 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6dec94c5-7b5e-4117-b188-f90734895118 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1113c785-6782-4a11-b591-05552a3e22aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:42 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6dec94c5-7b5e-4117-b188-f90734895118 1073741824 Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f050c6-cc86-4682-bc92-277baf9875e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:42 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:42 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Volume volume-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8 (154d4fc7-3e30-43e6-a695-8e8f9b91c7c8): created successfully Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f050c6-cc86-4682-bc92-277baf9875e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:42 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Flow 'volume_create_manager' (ab890495-485e-45c0-bd55-69e770b6847a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:42 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-10b6a02f-4525-4fac-ad16-72f2bc9e1902 tempest-CreateVolumesFromImageTest-541632467 None] Created volume successfully. Apr 16 13:35:43 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6dec94c5-7b5e-4117-b188-f90734895118 1073741824" returned: 0 in 0.488s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6dec94c5-7b5e-4117-b188-f90734895118 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:43 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6dec94c5-7b5e-4117-b188-f90734895118 Apr 16 13:35:43 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:43 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6dec94c5-7b5e-4117-b188-f90734895118" returned: 0 in 0.394s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.129s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-412248603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb925c2-eb75-42c5-960c-b511675549c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5474123c2ed14824a3ab32f5dddea5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:38Z,use_quota=True,user_id='e247bd44665a4f1a8bf52d025c9506c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Creating volume ffb925c2-eb75-42c5-960c-b511675549c1 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:35:43 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5818214f-19ba-4a10-8e0e-7e2cc6253a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dec94c5-7b5e-4117-b188-f90734895118', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:43 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1 1073741824 Apr 16 13:35:43 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9dc2092-5eed-4133-bd60-df0e13a26c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:43 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Volume volume-6dec94c5-7b5e-4117-b188-f90734895118 (6dec94c5-7b5e-4117-b188-f90734895118): created successfully Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9dc2092-5eed-4133-bd60-df0e13a26c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:43 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Flow 'volume_create_manager' (2ea96fca-1fef-4837-ad2e-73d1f8e9f999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:43 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-6bdc2e46-852e-4d17-801c-2de5519daf11 tempest-CreateVolumesFromImageTest-541632467 None] Created volume successfully. Apr 16 13:35:44 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1 1073741824" returned: 0 in 0.500s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:44 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1 Apr 16 13:35:44 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "cinder-6dec94c5-7b5e-4117-b188-f90734895118-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-6dec94c5-7b5e-4117-b188-f90734895118-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "cinder-quobyte-6dec94c5-7b5e-4117-b188-f90734895118" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-quobyte-6dec94c5-7b5e-4117-b188-f90734895118" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbc82d6-c0f5-4fdb-b349-d85fdbb9c8f2]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6dec94c5-7b5e-4117-b188-f90734895118 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:44 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1" returned: 0 in 0.417s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.116s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9daa16ff-5649-4c38-9c24-10df3b956a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb925c2-eb75-42c5-960c-b511675549c1', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0eb83fb-b7b7-4599-a501-896919abb63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] Creating offline snapshot 01f6b47d-a0bb-4679-a19f-269027e4dd07 of volume 969ed7c0-59b2-4f1d-8975-f70a1dda82a7 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ea8fcc-beac-4fb1-a0a1-94f65e86de7d]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:44 devstack sudo[91218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6dec94c5-7b5e-4117-b188-f90734895118 Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:44 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:44 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Volume volume-ffb925c2-eb75-42c5-960c-b511675549c1 (ffb925c2-eb75-42c5-960c-b511675549c1): created successfully Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0eb83fb-b7b7-4599-a501-896919abb63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:44 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Flow 'volume_create_manager' (11d63075-9d6c-44c2-a78a-24d548321bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:44 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-2ea3bfb8-531a-4217-a845-e76a953e60f1 tempest-CinderUnicodeTest-1943968668 None] Created volume successfully. Apr 16 13:35:44 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 Apr 16 13:35:44 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:45 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6dec94c5-7b5e-4117-b188-f90734895118" returned: 0 in 0.525s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6dec94c5-7b5e-4117-b188-f90734895118 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:45 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6dec94c5-7b5e-4117-b188-f90734895118 Apr 16 13:35:45 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:45 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7" returned: 0 in 0.500s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:45 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07 1G Apr 16 13:35:45 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:45 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6dec94c5-7b5e-4117-b188-f90734895118" returned: 0 in 0.426s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-quobyte-6dec94c5-7b5e-4117-b188-f90734895118" released by "delete_volume" :: held 0.972s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] Created reservations ['d09aacdd-2f1f-4c12-b954-7ab256e7c420', 'dfbe11ea-945f-4e59-818c-7ee30d8a1964', '1d5d98e0-58d4-414a-80a2-ea5921f72da1', 'ac681c0a-1c7b-4f0b-a9b5-7845894efd01'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:45 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07 1G" returned: 0 in 0.486s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:45 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:35:45 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "cinder-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:45 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07 Apr 16 13:35:45 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "cinder-quobyte-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-quobyte-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8" acquired by "delete_volume" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fbfab7-1234-488b-9d19-f5527e840fbd]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:45 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:45 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8 Apr 16 13:35:45 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:46 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.447s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:35:46 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] Deleted volume successfully. Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-be1bf4a7-d0f8-4b01-814e-14a40a0ce1ce tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-6dec94c5-7b5e-4117-b188-f90734895118-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:46 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07" returned: 0 in 0.502s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:46 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07 is being set with open permissions: ugo+rw Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:46 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07 Apr 16 13:35:46 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:46 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8" returned: 0 in 0.488s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:46 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8 Apr 16 13:35:46 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:46 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07" returned: 0 in 0.409s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:46 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.info Apr 16 13:35:46 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:46 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8" returned: 0 in 0.392s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-quobyte-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8" released by "delete_volume" :: held 0.900s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] Created reservations ['97b36d37-074f-4f10-aca3-8e273e8877bc', 'dc491de2-2ab1-462a-858f-303246f29669', '403214ed-742c-49b4-821c-e23541464ce0', 'f462b0cf-3a60-4aa8-aee2-022c06d8aa7f'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:46 devstack sudo[91257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:35:46 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "cinder-761ecb4e-5895-4095-92ca-181a19f7a36c-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-761ecb4e-5895-4095-92ca-181a19f7a36c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "cinder-quobyte-761ecb4e-5895-4095-92ca-181a19f7a36c" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-quobyte-761ecb4e-5895-4095-92ca-181a19f7a36c" acquired by "delete_volume" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b90e33-1af2-4305-8344-d72f10f0f992]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:46 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-761ecb4e-5895-4095-92ca-181a19f7a36c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:46 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-761ecb4e-5895-4095-92ca-181a19f7a36c Apr 16 13:35:46 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:47 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.info" returned: 0 in 0.450s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:47 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.info is being set with open permissions: ugo+rw Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:47 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.info Apr 16 13:35:47 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:47 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.467s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:35:47 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] Deleted volume successfully. Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-156aa2ca-2ef2-449c-814f-bf3f5347b250 tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-154d4fc7-3e30-43e6-a695-8e8f9b91c7c8-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:47 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-761ecb4e-5895-4095-92ca-181a19f7a36c" returned: 0 in 0.487s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-761ecb4e-5895-4095-92ca-181a19f7a36c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:47 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-761ecb4e-5895-4095-92ca-181a19f7a36c Apr 16 13:35:47 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:47 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.info" returned: 0 in 0.407s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.822s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.812s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:47 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-c48d0c39-9fc5-4552-a6f0-bf6b0c828657 tempest-VolumeDependencyTests-1512928148 None] Create snapshot completed successfully Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Creating offline snapshot 27503e05-6b8b-4619-b634-0a422d3754ce of volume 70363f4f-f18f-4863-b969-9fe13c4496b0 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab97f3d9-0a5c-463e-b3ab-f9f500d813b9]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:47 devstack sudo[91271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0 Apr 16 13:35:47 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:47 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-761ecb4e-5895-4095-92ca-181a19f7a36c" returned: 0 in 0.419s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-quobyte-761ecb4e-5895-4095-92ca-181a19f7a36c" released by "delete_volume" :: held 0.927s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] Created reservations ['193dc382-cd94-4895-8c88-c9eb4ee581df', '64d98cd2-6234-46e6-b2c5-44c01e9941d9', 'b2c302e5-85e1-4540-8eab-6d214415f8f9', 'df79209e-45e3-43d5-919e-22a40aa4f200'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:47 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:35:47 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:47 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "cinder-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "cinder-quobyte-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:48 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0" returned: 0 in 0.499s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-quobyte-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b" acquired by "delete_volume" :: waited 0.020s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e665bb3-624d-49c1-a83d-9cacd49175ac]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:48 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce 1G Apr 16 13:35:48 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:48 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b Apr 16 13:35:48 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Flow 'volume_create_manager' (d6a5da5e-a36d-49b0-b5f9-71b05f5ed871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b8da0a-3997-4268-9c0e-657d2690546e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b8da0a-3997-4268-9c0e-657d2690546e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-453992926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fef1fc7-d104-4d20-a210-c344156d76d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0134b50d4c44bfdbf468ca7409a88ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=01f6b47d-a0bb-4679-a19f-269027e4dd07,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:48Z,use_quota=True,user_id='e72081a71d1942b1b8e2cac7c5a20635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9db39eb-b803-4aeb-9e48-fae87e327cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9db39eb-b803-4aeb-9e48-fae87e327cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c291a74a-945d-4152-9066-47fc50a737b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c291a74a-945d-4152-9066-47fc50a737b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9fef1fc7-d104-4d20-a210-c344156d76d2', 'volume_name': 'volume-9fef1fc7-d104-4d20-a210-c344156d76d2', 'volume_size': 1, 'snapshot_id': '01f6b47d-a0bb-4679-a19f-269027e4dd07'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f0b110-439d-49a2-a0b4-c60b4921feb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f0b110-439d-49a2-a0b4-c60b4921feb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2491497-2623-4633-9bef-132d7532dc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:48 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Volume 9fef1fc7-d104-4d20-a210-c344156d76d2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9fef1fc7-d104-4d20-a210-c344156d76d2', 'volume_size': 1, 'snapshot_id': '01f6b47d-a0bb-4679-a19f-269027e4dd07'} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:48 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.475s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:35:48 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] Deleted volume successfully. Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-49e991b3-bd91-4392-bed3-6c6a7416b00e tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-761ecb4e-5895-4095-92ca-181a19f7a36c-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:48 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce 1G" returned: 0 in 0.497s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70363f4f-f18f-4863-b969-9fe13c4496b0 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:48 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70363f4f-f18f-4863-b969-9fe13c4496b0 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce Apr 16 13:35:48 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:48 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b" returned: 0 in 0.579s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:48 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:48 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b Apr 16 13:35:48 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:49 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70363f4f-f18f-4863-b969-9fe13c4496b0 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce" returned: 0 in 0.450s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:49 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce is being set with open permissions: ugo+rw Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:49 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce Apr 16 13:35:49 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:49 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b" returned: 0 in 0.427s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-quobyte-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b" released by "delete_volume" :: held 1.036s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] Created reservations ['9bff71e8-4d8d-40c2-8cba-b974752f7cc2', 'd8fad70f-46d7-4940-a1da-784bcde8f0bf', 'fbd57d0f-0217-49b6-90e1-233a4cbfc4f4', '6a26ddaf-a5f0-468e-8390-4d1093defec4'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:49 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:35:49 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:49 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce" returned: 0 in 0.430s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:49 devstack sudo[91303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.info Apr 16 13:35:49 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:49 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.436s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:35:49 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] Deleted volume successfully. Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-64fa87b9-1664-42c0-861a-6e5407453c67 tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-c0ad7c1c-c3ac-4fb3-a4d0-9af9b309052b-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:49 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.info" returned: 0 in 0.421s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:49 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.info is being set with open permissions: ugo+rw Apr 16 13:35:49 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:49 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.info Apr 16 13:35:49 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "cinder-6049fa79-1a2c-4d65-84d1-92536d0a425c-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-6049fa79-1a2c-4d65-84d1-92536d0a425c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "cinder-quobyte-6049fa79-1a2c-4d65-84d1-92536d0a425c" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:50 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-quobyte-6049fa79-1a2c-4d65-84d1-92536d0a425c" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:50 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c4a967-7e59-414e-99cc-50e9205dc1f2]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6049fa79-1a2c-4d65-84d1-92536d0a425c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:50 devstack sudo[91309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6049fa79-1a2c-4d65-84d1-92536d0a425c Apr 16 13:35:50 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:50 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.info" returned: 0 in 0.453s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.810s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.233s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:50 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] Creating offline snapshot 79aa6ef9-b748-4074-a58a-eb0246bec9d6 of volume ffb925c2-eb75-42c5-960c-b511675549c1 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:35:50 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5e326d-fa20-4dde-8358-39579dd4f205]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:50 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-a95b21cf-15b4-44cc-b83d-47d422bcd742 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Create snapshot completed successfully Apr 16 13:35:50 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1 Apr 16 13:35:50 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:50 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6049fa79-1a2c-4d65-84d1-92536d0a425c" returned: 0 in 0.483s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6049fa79-1a2c-4d65-84d1-92536d0a425c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:50 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6049fa79-1a2c-4d65-84d1-92536d0a425c Apr 16 13:35:50 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:50 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1" returned: 0 in 0.453s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:50 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:50 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6 1G Apr 16 13:35:50 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:51 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6049fa79-1a2c-4d65-84d1-92536d0a425c" returned: 0 in 0.447s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-quobyte-6049fa79-1a2c-4d65-84d1-92536d0a425c" released by "delete_volume" :: held 0.962s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] Created reservations ['d02f13a3-b4ee-4a32-acfb-1d276ab28627', '4f20c68d-ad24-471e-abc1-ca3cf4f5e62d', 'cc1a280c-beb0-433d-af57-ebbc660246f9', '6327764e-b628-4747-a4df-662ccc8d0bb2'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Flow 'volume_create_manager' (5111e04d-ff21-4543-b834-61f440316821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea42b7b1-fb6c-4586-bd50-854bc58976d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea42b7b1-fb6c-4586-bd50-854bc58976d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1771875680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafb33c7-6ffc-4e9a-ab14-10bf489b345a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4af35a4037f48cdb6b350775b2c0062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:51Z,use_quota=True,user_id='728469aae73c4c1195a98ff53e4891d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f20dcd3-a805-4bd6-b388-7c43f7e798cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:51 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f20dcd3-a805-4bd6-b388-7c43f7e798cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c83d7a-297d-4948-8a4b-8c9dd318674b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c83d7a-297d-4948-8a4b-8c9dd318674b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aafb33c7-6ffc-4e9a-ab14-10bf489b345a', 'volume_name': 'volume-aafb33c7-6ffc-4e9a-ab14-10bf489b345a', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8adaabb4-0774-4eb8-acdb-59c25fe9d7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8adaabb4-0774-4eb8-acdb-59c25fe9d7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17cfa0f0-092a-45cf-9a56-757e66646c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:51 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume aafb33c7-6ffc-4e9a-ab14-10bf489b345a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aafb33c7-6ffc-4e9a-ab14-10bf489b345a', 'volume_size': 1} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6 1G" returned: 0 in 0.556s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffb925c2-eb75-42c5-960c-b511675549c1 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:51 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffb925c2-eb75-42c5-960c-b511675549c1 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6 Apr 16 13:35:51 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:51 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:35:51 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Flow 'volume_create_manager' (2af5e419-6c38-4862-900c-4e8a8dd0bbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74cc66f5-496e-4579-9e06-b243dd33fc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74cc66f5-496e-4579-9e06-b243dd33fc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2044832309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38f3eac-d436-476c-a740-28ee8622c2de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4af35a4037f48cdb6b350775b2c0062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:52Z,use_quota=True,user_id='728469aae73c4c1195a98ff53e4891d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6504152c-af52-4d7f-a844-f1dab71de4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6504152c-af52-4d7f-a844-f1dab71de4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe47a658-ec66-4a13-866f-a64770487bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe47a658-ec66-4a13-866f-a64770487bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd38f3eac-d436-476c-a740-28ee8622c2de', 'volume_name': 'volume-d38f3eac-d436-476c-a740-28ee8622c2de', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d641b1c-6912-4567-baee-ededfc0c000d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d641b1c-6912-4567-baee-ededfc0c000d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d10175-a86b-43bb-9a37-ccb2b1e11396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:51 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume d38f3eac-d436-476c-a740-28ee8622c2de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d38f3eac-d436-476c-a740-28ee8622c2de', 'volume_size': 1} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Flow 'volume_create_manager' (5e717521-be48-4522-8393-ac7ee9704528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:51 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b093bfec-71d2-472c-8145-eb292bcfa030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b093bfec-71d2-472c-8145-eb292bcfa030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122041541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d5108a4-5ace-404a-aa4c-f8e057d769c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4af35a4037f48cdb6b350775b2c0062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:52Z,use_quota=True,user_id='728469aae73c4c1195a98ff53e4891d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098335ac-429f-4e36-b125-b46ad71e7aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098335ac-429f-4e36-b125-b46ad71e7aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0180a05d-5ec6-40c2-add9-a0b2e005540d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:51 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0180a05d-5ec6-40c2-add9-a0b2e005540d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d5108a4-5ace-404a-aa4c-f8e057d769c6', 'volume_name': 'volume-2d5108a4-5ace-404a-aa4c-f8e057d769c6', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdea5a2-a75c-48f7-b13b-b65bcb0740bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdea5a2-a75c-48f7-b13b-b65bcb0740bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09faf468-f718-4e3f-9042-ad7bc9b913fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:52 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume 2d5108a4-5ace-404a-aa4c-f8e057d769c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d5108a4-5ace-404a-aa4c-f8e057d769c6', 'volume_size': 1} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffb925c2-eb75-42c5-960c-b511675549c1 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6" returned: 0 in 0.643s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:52 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6 is being set with open permissions: ugo+rw Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:52 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6 Apr 16 13:35:52 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:52 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.675s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:35:52 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] Deleted volume successfully. Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Flow 'volume_create_manager' (a7ad9924-5fbc-4f40-b245-6aa47a0b5411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee63489-ada3-4579-abdb-0b35cc721bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7c13a79d-2aa0-428b-a903-75796955324c tempest-CreateVolumesFromImageTest-541632467 None] Lock "cinder-6049fa79-1a2c-4d65-84d1-92536d0a425c-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee63489-ada3-4579-abdb-0b35cc721bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1404688885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d227698d-e8e9-4012-8a2c-226e46078659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4af35a4037f48cdb6b350775b2c0062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:52Z,use_quota=True,user_id='728469aae73c4c1195a98ff53e4891d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc72448-c67e-45ec-bebd-f8d8e71c4284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc72448-c67e-45ec-bebd-f8d8e71c4284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b311193c-d269-4a48-a428-dd53cf54fa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b311193c-d269-4a48-a428-dd53cf54fa13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd227698d-e8e9-4012-8a2c-226e46078659', 'volume_name': 'volume-d227698d-e8e9-4012-8a2c-226e46078659', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c98c7d2-6153-486d-8ff1-5072c918c8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c98c7d2-6153-486d-8ff1-5072c918c8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6890e301-1093-4437-a39f-e4aef5dc0223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:52 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume d227698d-e8e9-4012-8a2c-226e46078659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d227698d-e8e9-4012-8a2c-226e46078659', 'volume_size': 1} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Flow 'volume_create_manager' (4e91585e-2197-49f7-87f8-fdba5e44e1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5188661b-49ca-4011-9abb-d9c53cce259c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5188661b-49ca-4011-9abb-d9c53cce259c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-619132239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4af35a4037f48cdb6b350775b2c0062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:52Z,use_quota=True,user_id='728469aae73c4c1195a98ff53e4891d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b7e421-6d0c-4113-b47d-b68d2b51a1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b7e421-6d0c-4113-b47d-b68d2b51a1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8591388a-9e6a-40d1-84ec-62618e72d3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8591388a-9e6a-40d1-84ec-62618e72d3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c', 'volume_name': 'volume-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ec3bf1-2111-499e-a442-e0a0f99686ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ec3bf1-2111-499e-a442-e0a0f99686ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7defe925-63b4-49d4-a7b1-39ce45ed9863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:52 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume 0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c', 'volume_size': 1} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:52 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6" returned: 0 in 0.543s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:52 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:52 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.info Apr 16 13:35:52 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:53 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.info" returned: 0 in 0.472s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:53 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.info is being set with open permissions: ugo+rw Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:53 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.info Apr 16 13:35:53 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Flow 'volume_create_manager' (25442762-9445-4b08-9a22-0db3fd285680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab4924e-14e4-4cd0-9caf-67c5da23b3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab4924e-14e4-4cd0-9caf-67c5da23b3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1814430280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d9c9fe-17c9-4256-b5a0-c04de23536f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ab3855781947e1a7eb8917d85d2b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:53Z,use_quota=True,user_id='4a42323d4f2849f5b05e9d0e0fac0f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (635382e4-481c-4363-a4d5-ede51a887cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (635382e4-481c-4363-a4d5-ede51a887cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc1d2a3-0483-406a-b73f-0bb1f43bac0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc1d2a3-0483-406a-b73f-0bb1f43bac0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d9c9fe-17c9-4256-b5a0-c04de23536f3', 'volume_name': 'volume-b9d9c9fe-17c9-4256-b5a0-c04de23536f3', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af25c1bc-d431-453c-983a-dc5ed8638532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af25c1bc-d431-453c-983a-dc5ed8638532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3910db61-be96-40ed-835b-5d5746eb7272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:53 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume b9d9c9fe-17c9-4256-b5a0-c04de23536f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d9c9fe-17c9-4256-b5a0-c04de23536f3', 'volume_size': 1} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:53 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.info" returned: 0 in 0.485s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.208s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.216s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "cinder-quobyte-01f6b47d-a0bb-4679-a19f-269027e4dd07-9fef1fc7-d104-4d20-a210-c344156d76d2" by "_create_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-01f6b47d-a0bb-4679-a19f-269027e4dd07-9fef1fc7-d104-4d20-a210-c344156d76d2" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Creating volume 9fef1fc7-d104-4d20-a210-c344156d76d2 from snapshot 01f6b47d-a0bb-4679-a19f-269027e4dd07 {{(pid=83606) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "cinder-quobyte-9fef1fc7-d104-4d20-a210-c344156d76d2" by "_copy_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:53 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-5babe4c6-39f5-4e89-bc49-526ccca12500 tempest-CinderUnicodeTest-1943968668 None] Create snapshot completed successfully Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-9fef1fc7-d104-4d20-a210-c344156d76d2" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] snapshot: 01f6b47d-a0bb-4679-a19f-269027e4dd07, volume: 9fef1fc7-d104-4d20-a210-c344156d76d2, {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[45093f3c-9d49-4687-a925-5cd83cba7ddf]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:53 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:53 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07 Apr 16 13:35:53 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:54 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07" returned: 0 in 0.472s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Creating direct copy from snapshot {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffeb5315-ed0f-4f12-b2b2-317a1e50537c]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:54 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 Apr 16 13:35:54 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] Acquiring lock "cinder-79aa6ef9-b748-4074-a58a-eb0246bec9d6-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] Lock "cinder-79aa6ef9-b748-4074-a58a-eb0246bec9d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] Acquiring lock "cinder-quobyte-ffb925c2-eb75-42c5-960c-b511675549c1" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] Lock "cinder-quobyte-ffb925c2-eb75-42c5-960c-b511675549c1" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] Acquiring lock "cinder-quobyte-79aa6ef9-b748-4074-a58a-eb0246bec9d6" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] Lock "cinder-quobyte-79aa6ef9-b748-4074-a58a-eb0246bec9d6" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] Deleting offline snapshot 79aa6ef9-b748-4074-a58a-eb0246bec9d6 of volume ffb925c2-eb75-42c5-960c-b511675549c1 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] snapshot_file for this snap is: volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4723ad1-b007-4834-aeed-0cde4bc5a133]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:54 devstack sudo[91356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6 Apr 16 13:35:54 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:54 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7" returned: 0 in 0.517s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG cinder.utils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Path /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9fef1fc7-d104-4d20-a210-c344156d76d2 not found in is_blk_device check {{(pid=83606) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9fef1fc7-d104-4d20-a210-c344156d76d2 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:54 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9fef1fc7-d104-4d20-a210-c344156d76d2 Apr 16 13:35:54 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:54 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6" returned: 0 in 0.459s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:54 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffb925c2-eb75-42c5-960c-b511675549c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:35:55 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a599d891-3263-466e-a084-9924145a44b0]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:55 devstack sudo[91366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1 Apr 16 13:35:55 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:55 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1" returned: 0 in 0.922s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:55 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:56 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6 Apr 16 13:35:56 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:56 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9fef1fc7-d104-4d20-a210-c344156d76d2" returned: 0 in 2.100s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:56 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[63762dd2-b6ef-4abc-b734-5697e8e065f4]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:56 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 Apr 16 13:35:56 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:56 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6" returned: 0 in 0.917s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:56 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:56 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6 Apr 16 13:35:56 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:57 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1.79aa6ef9-b748-4074-a58a-eb0246bec9d6" returned: 0 in 0.425s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] Lock "cinder-quobyte-79aa6ef9-b748-4074-a58a-eb0246bec9d6" released by "_delete_snapshot" :: held 2.781s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] Lock "cinder-quobyte-ffb925c2-eb75-42c5-960c-b511675549c1" released by "delete_snapshot" :: held 2.792s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:57 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7" returned: 0 in 0.583s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Image conversion details: src /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7, size 1024.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9fef1fc7-d104-4d20-a210-c344156d76d2 {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:35:57 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Converted 1024.00 MB image at 487.21 MB/s Apr 16 13:35:57 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9fef1fc7-d104-4d20-a210-c344156d76d2 is being set with open permissions: ugo+rw Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9fef1fc7-d104-4d20-a210-c344156d76d2 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:57 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9fef1fc7-d104-4d20-a210-c344156d76d2 Apr 16 13:35:57 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] Created reservations ['a610fcb0-adc4-4f2c-aa37-90063396635c', '404e640d-f8d6-416c-8570-c359068fab60', '824e4fd7-0a6d-41c1-9fde-1becd16647ec', 'cd3a7f38-9cba-4694-a996-eda13e133cd7'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:35:57 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] Delete snapshot completed successfully. Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7e2f5e4c-3f0b-4a76-9812-2835db77e638 tempest-CinderUnicodeTest-1943968668 None] Lock "cinder-79aa6ef9-b748-4074-a58a-eb0246bec9d6-delete_snapshot" released by "delete_snapshot" :: held 2.885s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] Acquiring lock "cinder-ffb925c2-eb75-42c5-960c-b511675549c1-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] Lock "cinder-ffb925c2-eb75-42c5-960c-b511675549c1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:57 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9fef1fc7-d104-4d20-a210-c344156d76d2" returned: 0 in 0.417s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-9fef1fc7-d104-4d20-a210-c344156d76d2" released by "_copy_volume_from_snapshot" :: held 4.145s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-01f6b47d-a0bb-4679-a19f-269027e4dd07-9fef1fc7-d104-4d20-a210-c344156d76d2" released by "_create_volume_from_snapshot" :: held 4.174s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.192s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.378s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1771875680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafb33c7-6ffc-4e9a-ab14-10bf489b345a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4af35a4037f48cdb6b350775b2c0062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:51Z,use_quota=True,user_id='728469aae73c4c1195a98ff53e4891d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Creating volume aafb33c7-6ffc-4e9a-ab14-10bf489b345a {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:35:57 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-aafb33c7-6ffc-4e9a-ab14-10bf489b345a 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] Acquiring lock "cinder-quobyte-ffb925c2-eb75-42c5-960c-b511675549c1" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:57 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-aafb33c7-6ffc-4e9a-ab14-10bf489b345a 1073741824 Apr 16 13:35:57 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] Lock "cinder-quobyte-ffb925c2-eb75-42c5-960c-b511675549c1" acquired by "delete_volume" :: waited 0.018s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2491497-2623-4633-9bef-132d7532dc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fef1fc7-d104-4d20-a210-c344156d76d2', 'volume_size': 1, 'snapshot_id': '01f6b47d-a0bb-4679-a19f-269027e4dd07'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26dde54-0dfc-4843-8dc5-2e081c14791f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1c7652-7b14-45a4-8d82-1ed240623437]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:57 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Volume volume-9fef1fc7-d104-4d20-a210-c344156d76d2 (9fef1fc7-d104-4d20-a210-c344156d76d2): created successfully Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26dde54-0dfc-4843-8dc5-2e081c14791f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:57 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Flow 'volume_create_manager' (d6a5da5e-a36d-49b0-b5f9-71b05f5ed871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:57 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-76771824-4de5-4142-bb01-5f91ab8dbbf3 tempest-VolumeDependencyTests-1512928148 None] Created volume successfully. Apr 16 13:35:57 devstack sudo[91402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1 Apr 16 13:35:57 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:58 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-aafb33c7-6ffc-4e9a-ab14-10bf489b345a 1073741824" returned: 0 in 0.486s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-aafb33c7-6ffc-4e9a-ab14-10bf489b345a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:58 devstack sudo[91410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-aafb33c7-6ffc-4e9a-ab14-10bf489b345a Apr 16 13:35:58 devstack sudo[91410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:58 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1" returned: 0 in 0.486s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:58 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1 Apr 16 13:35:58 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:58 devstack sudo[91410]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-aafb33c7-6ffc-4e9a-ab14-10bf489b345a" returned: 0 in 0.426s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.015s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2044832309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38f3eac-d436-476c-a740-28ee8622c2de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4af35a4037f48cdb6b350775b2c0062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:52Z,use_quota=True,user_id='728469aae73c4c1195a98ff53e4891d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Creating volume d38f3eac-d436-476c-a740-28ee8622c2de {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:58 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:35:58 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d38f3eac-d436-476c-a740-28ee8622c2de 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-ffb925c2-eb75-42c5-960c-b511675549c1" returned: 0 in 0.407s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:58 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d38f3eac-d436-476c-a740-28ee8622c2de 1073741824 Apr 16 13:35:58 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17cfa0f0-092a-45cf-9a56-757e66646c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aafb33c7-6ffc-4e9a-ab14-10bf489b345a', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4516a4-125a-4ec4-8cdd-b8262ebe1daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] Lock "cinder-quobyte-ffb925c2-eb75-42c5-960c-b511675549c1" released by "delete_volume" :: held 0.948s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:58 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume volume-aafb33c7-6ffc-4e9a-ab14-10bf489b345a (aafb33c7-6ffc-4e9a-ab14-10bf489b345a): created successfully Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4516a4-125a-4ec4-8cdd-b8262ebe1daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Flow 'volume_create_manager' (5111e04d-ff21-4543-b834-61f440316821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:58 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-2b5a9915-0188-4e76-800a-3d2785a5b6cb tempest-CreateVolumesFromSnapshotTest-1747326201 None] Created volume successfully. Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] Created reservations ['4388d22d-271c-4acb-b0c4-9a2cb70a6f9d', 'ce13a7cd-ea69-47b1-844f-30a5d0f2a16f', '17e19abc-862c-44ab-a158-b3a7c6fc4d5f', '4cf580b9-5c93-4ec3-ab40-48b7bfe6ee5d'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "cinder-01f6b47d-a0bb-4679-a19f-269027e4dd07-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-01f6b47d-a0bb-4679-a19f-269027e4dd07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "cinder-quobyte-969ed7c0-59b2-4f1d-8975-f70a1dda82a7" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:58 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:35:58 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-969ed7c0-59b2-4f1d-8975-f70a1dda82a7" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "cinder-quobyte-01f6b47d-a0bb-4679-a19f-269027e4dd07" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-01f6b47d-a0bb-4679-a19f-269027e4dd07" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] Deleting offline snapshot 01f6b47d-a0bb-4679-a19f-269027e4dd07 of volume 969ed7c0-59b2-4f1d-8975-f70a1dda82a7 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] snapshot_file for this snap is: volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[57011276-8f28-4ce6-bc0a-6e9a42993fcb]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:58 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:58 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07 Apr 16 13:35:58 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:59 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d38f3eac-d436-476c-a740-28ee8622c2de 1073741824" returned: 0 in 0.522s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d38f3eac-d436-476c-a740-28ee8622c2de {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:59 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d38f3eac-d436-476c-a740-28ee8622c2de Apr 16 13:35:59 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:59 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.430s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:35:59 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] Deleted volume successfully. Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d4c61e23-5a25-48b0-8e03-59c5cebf5940 tempest-CinderUnicodeTest-1943968668 None] Lock "cinder-ffb925c2-eb75-42c5-960c-b511675549c1-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:35:59 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07" returned: 0 in 0.479s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a595331-3630-49cc-8d5d-6c3777ec5e95]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:59 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 Apr 16 13:35:59 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:59 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d38f3eac-d436-476c-a740-28ee8622c2de" returned: 0 in 0.441s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.674s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122041541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d5108a4-5ace-404a-aa4c-f8e057d769c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4af35a4037f48cdb6b350775b2c0062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:52Z,use_quota=True,user_id='728469aae73c4c1195a98ff53e4891d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Creating volume 2d5108a4-5ace-404a-aa4c-f8e057d769c6 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:35:59 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d5108a4-5ace-404a-aa4c-f8e057d769c6 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d10175-a86b-43bb-9a37-ccb2b1e11396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d38f3eac-d436-476c-a740-28ee8622c2de', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f71da8eb-c19a-4c3d-89de-cfe9f2e7a820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:35:59 devstack sudo[91434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d5108a4-5ace-404a-aa4c-f8e057d769c6 1073741824 Apr 16 13:35:59 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:59 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume volume-d38f3eac-d436-476c-a740-28ee8622c2de (d38f3eac-d436-476c-a740-28ee8622c2de): created successfully Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f71da8eb-c19a-4c3d-89de-cfe9f2e7a820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Flow 'volume_create_manager' (2af5e419-6c38-4862-900c-4e8a8dd0bbf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:35:59 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-68f92ca0-a5b8-47cf-a931-9f3648438475 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Created volume successfully. Apr 16 13:35:59 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7" returned: 0 in 0.462s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] Acquiring lock "cinder-868863a0-4c19-4c03-9d0b-0fb94007213f-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:59 devstack sudo[91439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07 Apr 16 13:35:59 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] Lock "cinder-868863a0-4c19-4c03-9d0b-0fb94007213f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] Acquiring lock "cinder-quobyte-868863a0-4c19-4c03-9d0b-0fb94007213f" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] Lock "cinder-quobyte-868863a0-4c19-4c03-9d0b-0fb94007213f" acquired by "delete_volume" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b4d663-f026-43fd-847e-64211e580101]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:35:59 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-868863a0-4c19-4c03-9d0b-0fb94007213f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:00 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-868863a0-4c19-4c03-9d0b-0fb94007213f Apr 16 13:36:00 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:00 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d5108a4-5ace-404a-aa4c-f8e057d769c6 1073741824" returned: 0 in 0.543s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d5108a4-5ace-404a-aa4c-f8e057d769c6 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:00 devstack sudo[91448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d5108a4-5ace-404a-aa4c-f8e057d769c6 Apr 16 13:36:00 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:00 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07" returned: 0 in 0.527s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:00 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07 Apr 16 13:36:00 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:00 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-868863a0-4c19-4c03-9d0b-0fb94007213f" returned: 0 in 0.506s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-868863a0-4c19-4c03-9d0b-0fb94007213f {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:00 devstack sudo[91456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-868863a0-4c19-4c03-9d0b-0fb94007213f Apr 16 13:36:00 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:00 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d5108a4-5ace-404a-aa4c-f8e057d769c6" returned: 0 in 0.400s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.486s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1404688885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d227698d-e8e9-4012-8a2c-226e46078659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4af35a4037f48cdb6b350775b2c0062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:52Z,use_quota=True,user_id='728469aae73c4c1195a98ff53e4891d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Creating volume d227698d-e8e9-4012-8a2c-226e46078659 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:36:00 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d227698d-e8e9-4012-8a2c-226e46078659 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09faf468-f718-4e3f-9042-ad7bc9b913fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d5108a4-5ace-404a-aa4c-f8e057d769c6', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:00 devstack sudo[91459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d227698d-e8e9-4012-8a2c-226e46078659 1073741824 Apr 16 13:36:00 devstack sudo[91459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261ce61f-e2d7-445a-bfa1-24b384055ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:00 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume volume-2d5108a4-5ace-404a-aa4c-f8e057d769c6 (2d5108a4-5ace-404a-aa4c-f8e057d769c6): created successfully Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261ce61f-e2d7-445a-bfa1-24b384055ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Flow 'volume_create_manager' (5e717521-be48-4522-8393-ac7ee9704528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:00 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-255c66ca-86b7-4500-960f-9d1ecb85433a tempest-CreateVolumesFromSnapshotTest-1747326201 None] Created volume successfully. Apr 16 13:36:00 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7.01f6b47d-a0bb-4679-a19f-269027e4dd07" returned: 0 in 0.443s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-01f6b47d-a0bb-4679-a19f-269027e4dd07" released by "_delete_snapshot" :: held 1.959s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-969ed7c0-59b2-4f1d-8975-f70a1dda82a7" released by "delete_snapshot" :: held 1.970s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:00 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] Created reservations ['ef791025-a92d-4a28-aaaf-79f132c90a1a', 'f5b90325-b3e1-448f-a260-a1e3467f8517', 'bc9bae69-907f-4b6f-9aac-32df307591b4', 'a9e4be4a-46a9-4912-bea3-ea4cec5ff8a5'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-868863a0-4c19-4c03-9d0b-0fb94007213f" returned: 0 in 0.412s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] Lock "cinder-quobyte-868863a0-4c19-4c03-9d0b-0fb94007213f" released by "delete_volume" :: held 0.940s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:00 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] Delete snapshot completed successfully. Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-6ff138b0-54aa-4d43-af5e-aa60d6ca0af5 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-01f6b47d-a0bb-4679-a19f-269027e4dd07-delete_snapshot" released by "delete_snapshot" :: held 2.083s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:00 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] Created reservations ['5e6e2aad-e9df-475d-96ea-3f342090e5c7', 'ca73654d-d33a-4efa-b836-6b4a77f9a7e7', '1e6b5f84-7f03-4bb4-8e36-91dd653a4768', 'b1740e12-14f3-4263-98fe-b1ed8072ef90'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:01 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:01 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "cinder-969ed7c0-59b2-4f1d-8975-f70a1dda82a7-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-969ed7c0-59b2-4f1d-8975-f70a1dda82a7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "cinder-quobyte-969ed7c0-59b2-4f1d-8975-f70a1dda82a7" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-969ed7c0-59b2-4f1d-8975-f70a1dda82a7" acquired by "delete_volume" :: waited 0.020s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cbca4f-4c38-462a-b6af-8c826822aaa4]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:01 devstack sudo[91468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 Apr 16 13:36:01 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:01 devstack sudo[91459]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d227698d-e8e9-4012-8a2c-226e46078659 1073741824" returned: 0 in 0.548s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d227698d-e8e9-4012-8a2c-226e46078659 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:01 devstack sudo[91470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d227698d-e8e9-4012-8a2c-226e46078659 Apr 16 13:36:01 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:01 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.421s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:01 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] Deleted volume successfully. Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-061f1b98-301c-4370-ac2f-bd89817e4431 tempest-CinderUnicodeTest-1943968668 None] Lock "cinder-868863a0-4c19-4c03-9d0b-0fb94007213f-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:01 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7" returned: 0 in 0.474s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:01 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7 Apr 16 13:36:01 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:01 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d227698d-e8e9-4012-8a2c-226e46078659" returned: 0 in 0.413s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.253s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-619132239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4af35a4037f48cdb6b350775b2c0062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:52Z,use_quota=True,user_id='728469aae73c4c1195a98ff53e4891d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Creating volume 0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:36:01 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6890e301-1093-4437-a39f-e4aef5dc0223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d227698d-e8e9-4012-8a2c-226e46078659', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:01 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c 1073741824 Apr 16 13:36:01 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbea1a0e-37ae-40af-84f2-edf7b84ff062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:01 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume volume-d227698d-e8e9-4012-8a2c-226e46078659 (d227698d-e8e9-4012-8a2c-226e46078659): created successfully Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbea1a0e-37ae-40af-84f2-edf7b84ff062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:01 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Flow 'volume_create_manager' (a7ad9924-5fbc-4f40-b245-6aa47a0b5411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:01 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-24e7adb3-b09a-4c4c-af38-2d11b22ad0cf tempest-CreateVolumesFromSnapshotTest-1747326201 None] Created volume successfully. Apr 16 13:36:02 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-969ed7c0-59b2-4f1d-8975-f70a1dda82a7" returned: 0 in 0.459s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-969ed7c0-59b2-4f1d-8975-f70a1dda82a7" released by "delete_volume" :: held 0.958s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] Created reservations ['cd8931a8-16e8-41c2-8674-203fae8d4954', 'b8787416-7dec-46f8-824c-e3cc764fdedd', '9af43e97-ce36-427d-883f-07a28dee74b8', '905e2ef7-e413-4aa7-bf97-9f8bc9199148'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:02 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:02 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:02 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c 1073741824" returned: 0 in 0.547s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:02 devstack sudo[91487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c Apr 16 13:36:02 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Flow 'volume_create_manager' (44b0957a-94f0-43e5-afa3-c0e1808780b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de97ae52-06c9-446c-96b3-abf4ed5979ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de97ae52-06c9-446c-96b3-abf4ed5979ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1064925915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7460f83-e1ab-4357-830f-f9e47004ce0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0134b50d4c44bfdbf468ca7409a88ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:36:02Z,use_quota=True,user_id='e72081a71d1942b1b8e2cac7c5a20635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c4e6c5-2440-4c4a-b1d3-560c87a9b83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c4e6c5-2440-4c4a-b1d3-560c87a9b83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299f4c55-75f4-44bd-be45-8fd76a992053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299f4c55-75f4-44bd-be45-8fd76a992053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7460f83-e1ab-4357-830f-f9e47004ce0c', 'volume_name': 'volume-e7460f83-e1ab-4357-830f-f9e47004ce0c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60daf78e-8583-4ace-92a0-1ce5b655c063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60daf78e-8583-4ace-92a0-1ce5b655c063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd1f2ca-ec6f-4fa1-8185-81cf328fdffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:02 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Volume e7460f83-e1ab-4357-830f-f9e47004ce0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7460f83-e1ab-4357-830f-f9e47004ce0c', 'volume_size': 1} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:02 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.511s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:02 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] Deleted volume successfully. Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-163c83c5-9734-4716-a6ce-4ff99b473b3d tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-969ed7c0-59b2-4f1d-8975-f70a1dda82a7-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:02 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c" returned: 0 in 0.530s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.276s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1814430280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d9c9fe-17c9-4256-b5a0-c04de23536f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ab3855781947e1a7eb8917d85d2b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:35:53Z,use_quota=True,user_id='4a42323d4f2849f5b05e9d0e0fac0f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Creating volume b9d9c9fe-17c9-4256-b5a0-c04de23536f3 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:36:02 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b9d9c9fe-17c9-4256-b5a0-c04de23536f3 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7defe925-63b4-49d4-a7b1-39ce45ed9863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14747a0-c3ae-4ce6-a283-09008e5d34e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:02 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b9d9c9fe-17c9-4256-b5a0-c04de23536f3 1073741824 Apr 16 13:36:02 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:02 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Volume volume-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c (0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c): created successfully Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14747a0-c3ae-4ce6-a283-09008e5d34e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:02 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Flow 'volume_create_manager' (4e91585e-2197-49f7-87f8-fdba5e44e1e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:02 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-1ef82e7f-1f9c-4f5f-94cf-553ae7cd8684 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Created volume successfully. Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "cinder-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "cinder-quobyte-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-quobyte-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74f7858-434a-4d31-9468-996640269774]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:03 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b9d9c9fe-17c9-4256-b5a0-c04de23536f3 1073741824" returned: 0 in 0.618s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b9d9c9fe-17c9-4256-b5a0-c04de23536f3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:03 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c Apr 16 13:36:03 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:03 devstack sudo[91534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b9d9c9fe-17c9-4256-b5a0-c04de23536f3 Apr 16 13:36:03 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:03 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b9d9c9fe-17c9-4256-b5a0-c04de23536f3" returned: 0 in 0.455s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.330s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1064925915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7460f83-e1ab-4357-830f-f9e47004ce0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0134b50d4c44bfdbf468ca7409a88ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:36:02Z,use_quota=True,user_id='e72081a71d1942b1b8e2cac7c5a20635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Creating volume e7460f83-e1ab-4357-830f-f9e47004ce0c {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:36:03 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:03 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c" returned: 0 in 0.551s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:03 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c 1073741824 Apr 16 13:36:03 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3910db61-be96-40ed-835b-5d5746eb7272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d9c9fe-17c9-4256-b5a0-c04de23536f3', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11dd9373-7900-40a9-87da-4757ba085c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:03 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c Apr 16 13:36:03 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:03 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume volume-b9d9c9fe-17c9-4256-b5a0-c04de23536f3 (b9d9c9fe-17c9-4256-b5a0-c04de23536f3): created successfully Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11dd9373-7900-40a9-87da-4757ba085c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:03 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Flow 'volume_create_manager' (25442762-9445-4b08-9a22-0db3fd285680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:03 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-96a86784-5b4a-4e81-8e5d-23b83df1ff5d tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Created volume successfully. Apr 16 13:36:04 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c" returned: 0 in 0.463s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:04 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-quobyte-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c" released by "delete_volume" :: held 1.048s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:04 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] Created reservations ['0a77c644-9373-42dc-902a-b81c6329f91b', 'f3859556-79eb-4187-a131-0fc3b897c3c6', '5d349a37-83eb-4ee3-942e-3ea0edcb17ae', 'f3cad815-dd72-4710-8f47-23abc1e34025'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:04 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:04 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:04 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:04 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:04 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c 1073741824" returned: 0 in 0.644s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:04 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c Apr 16 13:36:04 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:04 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:04 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.453s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:04 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:04 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] Deleted volume successfully. Apr 16 13:36:04 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:SELECT=130,cinder:UPDATE=146,cinder:INSERT=44,cinder:DELETE=17 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:36:04 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-71d327a7-7ffa-45ae-8bab-5d003d438f8e tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-0f5f6db6-f1fe-4cc1-a303-318e6a2fcc6c-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:05 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c" returned: 0 in 0.424s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd1f2ca-ec6f-4fa1-8185-81cf328fdffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7460f83-e1ab-4357-830f-f9e47004ce0c', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cddfedca-b1b4-4da0-b270-dd1fa273bb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:05 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Volume volume-e7460f83-e1ab-4357-830f-f9e47004ce0c (e7460f83-e1ab-4357-830f-f9e47004ce0c): created successfully Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cddfedca-b1b4-4da0-b270-dd1fa273bb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Flow 'volume_create_manager' (44b0957a-94f0-43e5-afa3-c0e1808780b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:05 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-95a4d1ea-056d-4558-8ea3-7afb0ca4365f tempest-VolumeDependencyTests-1512928148 None] Created volume successfully. Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Flow 'volume_create_manager' (82eac984-5fb0-4bdd-8cc7-505ac181d20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1035d813-017c-4bd3-923f-bddc9a04476f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1035d813-017c-4bd3-923f-bddc9a04476f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-820900031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3e9af6-371c-48d4-8e77-f6a581f59c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ab3855781947e1a7eb8917d85d2b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:36:05Z,use_quota=True,user_id='4a42323d4f2849f5b05e9d0e0fac0f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55955d83-fc12-45c1-8bf8-31a5240519ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55955d83-fc12-45c1-8bf8-31a5240519ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cefbc5-4b4c-4186-874f-188723be6a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cefbc5-4b4c-4186-874f-188723be6a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c3e9af6-371c-48d4-8e77-f6a581f59c5e', 'volume_name': 'volume-6c3e9af6-371c-48d4-8e77-f6a581f59c5e', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5992c9f8-35dc-4c8c-bbee-e5dac7734b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5992c9f8-35dc-4c8c-bbee-e5dac7734b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad5193a-347b-4721-9d21-596bd88fcb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:05 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume 6c3e9af6-371c-48d4-8e77-f6a581f59c5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c3e9af6-371c-48d4-8e77-f6a581f59c5e', 'volume_size': 1} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-820900031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3e9af6-371c-48d4-8e77-f6a581f59c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ab3855781947e1a7eb8917d85d2b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:36:05Z,use_quota=True,user_id='4a42323d4f2849f5b05e9d0e0fac0f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Creating volume 6c3e9af6-371c-48d4-8e77-f6a581f59c5e {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:36:05 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6c3e9af6-371c-48d4-8e77-f6a581f59c5e 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:05 devstack sudo[91556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6c3e9af6-371c-48d4-8e77-f6a581f59c5e 1073741824 Apr 16 13:36:05 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:SELECT=121,cinder:UPDATE=185,cinder:DELETE=16,cinder:INSERT=33 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Flow 'volume_create_manager' (abbf7353-43da-42ae-95e6-141141d0e130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6043372-7c4f-4058-956b-86af646b9b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "cinder-d227698d-e8e9-4012-8a2c-226e46078659-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6043372-7c4f-4058-956b-86af646b9b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-753526880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f94ce1-bd33-4958-be32-79be4ad35032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ab3855781947e1a7eb8917d85d2b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:36:05Z,use_quota=True,user_id='4a42323d4f2849f5b05e9d0e0fac0f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0fb4a6b-1cd0-47b1-a506-845a37a66b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0fb4a6b-1cd0-47b1-a506-845a37a66b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43cf12d4-a155-4b95-b0ca-95eb60c74187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43cf12d4-a155-4b95-b0ca-95eb60c74187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30f94ce1-bd33-4958-be32-79be4ad35032', 'volume_name': 'volume-30f94ce1-bd33-4958-be32-79be4ad35032', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2126d26-3148-488c-8ea5-ae44b4af04e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2126d26-3148-488c-8ea5-ae44b4af04e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bcb13e-ff8c-454c-959b-1a2a30624f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:05 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume 30f94ce1-bd33-4958-be32-79be4ad35032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30f94ce1-bd33-4958-be32-79be4ad35032', 'volume_size': 1} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-d227698d-e8e9-4012-8a2c-226e46078659-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "cinder-quobyte-d227698d-e8e9-4012-8a2c-226e46078659" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-quobyte-d227698d-e8e9-4012-8a2c-226e46078659" acquired by "delete_volume" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[587535b5-5d29-47bb-b7ed-e687a3313b99]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d227698d-e8e9-4012-8a2c-226e46078659 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:05 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d227698d-e8e9-4012-8a2c-226e46078659 Apr 16 13:36:05 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Flow 'volume_create_manager' (04490e1c-439e-42a8-bcdd-54c8cf8fe4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:05 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611d79d3-36d2-46eb-9ea7-b1fcff1c9976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611d79d3-36d2-46eb-9ea7-b1fcff1c9976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-697816687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e09c18e-577c-41a4-b95b-b372740123d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ab3855781947e1a7eb8917d85d2b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:36:06Z,use_quota=True,user_id='4a42323d4f2849f5b05e9d0e0fac0f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fcb4500-4255-48c2-a954-1914f707328d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fcb4500-4255-48c2-a954-1914f707328d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72542851-4963-4a57-b80f-fef9f648a71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72542851-4963-4a57-b80f-fef9f648a71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e09c18e-577c-41a4-b95b-b372740123d5', 'volume_name': 'volume-2e09c18e-577c-41a4-b95b-b372740123d5', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6863981-dae2-4355-b6b1-1676228a14e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6863981-dae2-4355-b6b1-1676228a14e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8222f4-aef9-498c-88be-48f3525f0bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume 2e09c18e-577c-41a4-b95b-b372740123d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e09c18e-577c-41a4-b95b-b372740123d5', 'volume_size': 1} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:06 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6c3e9af6-371c-48d4-8e77-f6a581f59c5e 1073741824" returned: 0 in 0.770s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Flow 'volume_create_manager' (1fe7f8c4-2e6f-45f9-a9f5-6ea6138bdb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2263e3d1-4b5f-45d6-9ec2-b695f4abf837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6c3e9af6-371c-48d4-8e77-f6a581f59c5e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:36:06 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6c3e9af6-371c-48d4-8e77-f6a581f59c5e Apr 16 13:36:06 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Flow 'volume_create_manager' (5c2afb71-9714-48e1-bd9c-1e0a55c5f8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc056327-4df0-46a5-a6a7-eb504710af22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2263e3d1-4b5f-45d6-9ec2-b695f4abf837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-903883862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e1df37-2cf9-4112-9a31-26071272e774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0134b50d4c44bfdbf468ca7409a88ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e7460f83-e1ab-4357-830f-f9e47004ce0c,status='creating',terminated_at=None,updated_at=2026-04-16T11:36:06Z,use_quota=True,user_id='e72081a71d1942b1b8e2cac7c5a20635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d1b6b9-e5be-4175-a80e-e7c2df65156b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d1b6b9-e5be-4175-a80e-e7c2df65156b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2645f7e3-c800-4e41-85ee-002a2fbe1e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc056327-4df0-46a5-a6a7-eb504710af22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256525931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f51bd2e-1756-43bd-8b3c-3aae35d70f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ab3855781947e1a7eb8917d85d2b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:36:06Z,use_quota=True,user_id='4a42323d4f2849f5b05e9d0e0fac0f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539d4e4d-457d-48b3-a6c2-63b0cf6f92e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539d4e4d-457d-48b3-a6c2-63b0cf6f92e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c697283e-ff84-4993-8c21-b3ad63c854e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c697283e-ff84-4993-8c21-b3ad63c854e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f51bd2e-1756-43bd-8b3c-3aae35d70f1e', 'volume_name': 'volume-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02bc588-4e0e-4ab1-b472-cdfc9f46e144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02bc588-4e0e-4ab1-b472-cdfc9f46e144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10aa6e52-9d89-43af-8a59-f66719fd10e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume 5f51bd2e-1756-43bd-8b3c-3aae35d70f1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e', 'volume_size': 1} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2645f7e3-c800-4e41-85ee-002a2fbe1e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '83e1df37-2cf9-4112-9a31-26071272e774', 'volume_name': 'volume-83e1df37-2cf9-4112-9a31-26071272e774', 'volume_size': 1, 'source_volid': 'e7460f83-e1ab-4357-830f-f9e47004ce0c', 'source_volstatus': 'available'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f2b69f-c698-4f30-8bb4-6aa0392fe3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f2b69f-c698-4f30-8bb4-6aa0392fe3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5764a0-6244-4a4d-9784-e2e59c136d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Volume 83e1df37-2cf9-4112-9a31-26071272e774: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-83e1df37-2cf9-4112-9a31-26071272e774', 'volume_size': 1, 'source_volid': 'e7460f83-e1ab-4357-830f-f9e47004ce0c', 'source_volstatus': 'available'} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d227698d-e8e9-4012-8a2c-226e46078659" returned: 0 in 0.830s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d227698d-e8e9-4012-8a2c-226e46078659 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:06 devstack sudo[91568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d227698d-e8e9-4012-8a2c-226e46078659 Apr 16 13:36:06 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Flow 'volume_create_manager' (de25c0a6-e2b9-4ba1-8c53-9aec241846e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f247f5-9fb0-4662-92cf-29c42bd34fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f247f5-9fb0-4662-92cf-29c42bd34fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-409734851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463f5c78-9ea9-4d8a-9af3-dac1de727631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ab3855781947e1a7eb8917d85d2b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:36:06Z,use_quota=True,user_id='4a42323d4f2849f5b05e9d0e0fac0f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73d09c3-4fa6-4027-8713-b73a5b8412f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73d09c3-4fa6-4027-8713-b73a5b8412f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9c0897-f4a9-4fff-ac0a-a5ccfd058d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9c0897-f4a9-4fff-ac0a-a5ccfd058d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '463f5c78-9ea9-4d8a-9af3-dac1de727631', 'volume_name': 'volume-463f5c78-9ea9-4d8a-9af3-dac1de727631', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a111ef55-7fa7-4426-9107-ba1657be6e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a111ef55-7fa7-4426-9107-ba1657be6e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebeec07-d6a6-40ad-98d5-2cda582c5d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume 463f5c78-9ea9-4d8a-9af3-dac1de727631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-463f5c78-9ea9-4d8a-9af3-dac1de727631', 'volume_size': 1} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:06 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6c3e9af6-371c-48d4-8e77-f6a581f59c5e" returned: 0 in 0.577s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.264s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-753526880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f94ce1-bd33-4958-be32-79be4ad35032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ab3855781947e1a7eb8917d85d2b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:36:05Z,use_quota=True,user_id='4a42323d4f2849f5b05e9d0e0fac0f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Creating volume 30f94ce1-bd33-4958-be32-79be4ad35032 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:36:06 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-30f94ce1-bd33-4958-be32-79be4ad35032 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad5193a-347b-4721-9d21-596bd88fcb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c3e9af6-371c-48d4-8e77-f6a581f59c5e', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-30f94ce1-bd33-4958-be32-79be4ad35032 1073741824 Apr 16 13:36:06 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbadce40-eb80-44c3-b972-aa1a1b21cc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:06 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume volume-6c3e9af6-371c-48d4-8e77-f6a581f59c5e (6c3e9af6-371c-48d4-8e77-f6a581f59c5e): created successfully Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbadce40-eb80-44c3-b972-aa1a1b21cc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Flow 'volume_create_manager' (82eac984-5fb0-4bdd-8cc7-505ac181d20d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:06 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-da65faef-a3ed-46d9-8e97-843cf8e6ea9a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Created volume successfully. Apr 16 13:36:06 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d227698d-e8e9-4012-8a2c-226e46078659" returned: 0 in 0.506s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:06 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-quobyte-d227698d-e8e9-4012-8a2c-226e46078659" released by "delete_volume" :: held 1.359s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] Created reservations ['da0a34c0-bfb2-4b5d-b175-78c3a95ba2a3', '93538774-d1ee-4b4a-8a54-2f86555b97b1', 'b2abde33-744f-4b11-8db8-fe0d01c2c832', '293c0426-1969-457d-8839-6983aeb8c4c5'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:07 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:07 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:07 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-30f94ce1-bd33-4958-be32-79be4ad35032 1073741824" returned: 0 in 0.630s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-30f94ce1-bd33-4958-be32-79be4ad35032 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:07 devstack sudo[91580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-30f94ce1-bd33-4958-be32-79be4ad35032 Apr 16 13:36:07 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:07 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.572s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:07 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] Deleted volume successfully. Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-aa1700f8-9ca8-4144-9d2f-fe60ff14218c tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-d227698d-e8e9-4012-8a2c-226e46078659-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "cinder-2d5108a4-5ace-404a-aa4c-f8e057d769c6-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-2d5108a4-5ace-404a-aa4c-f8e057d769c6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "cinder-quobyte-2d5108a4-5ace-404a-aa4c-f8e057d769c6" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-quobyte-2d5108a4-5ace-404a-aa4c-f8e057d769c6" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9145b3cf-0efa-4ce7-9f0f-04fedf680c87]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d5108a4-5ace-404a-aa4c-f8e057d769c6 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:07 devstack sudo[91582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d5108a4-5ace-404a-aa4c-f8e057d769c6 Apr 16 13:36:07 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:07 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-30f94ce1-bd33-4958-be32-79be4ad35032" returned: 0 in 0.461s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.963s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-697816687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e09c18e-577c-41a4-b95b-b372740123d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ab3855781947e1a7eb8917d85d2b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:36:06Z,use_quota=True,user_id='4a42323d4f2849f5b05e9d0e0fac0f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Creating volume 2e09c18e-577c-41a4-b95b-b372740123d5 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:07 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:36:08 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2e09c18e-577c-41a4-b95b-b372740123d5 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bcb13e-ff8c-454c-959b-1a2a30624f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f94ce1-bd33-4958-be32-79be4ad35032', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c7a2a6-a708-4744-8621-87a9b8b75136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:08 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2e09c18e-577c-41a4-b95b-b372740123d5 1073741824 Apr 16 13:36:08 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:08 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume volume-30f94ce1-bd33-4958-be32-79be4ad35032 (30f94ce1-bd33-4958-be32-79be4ad35032): created successfully Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c7a2a6-a708-4744-8621-87a9b8b75136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Flow 'volume_create_manager' (abbf7353-43da-42ae-95e6-141141d0e130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:08 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-5e0ee84d-5ac2-44e0-9bdd-1ed6214d47ef tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Created volume successfully. Apr 16 13:36:08 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d5108a4-5ace-404a-aa4c-f8e057d769c6" returned: 0 in 0.568s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d5108a4-5ace-404a-aa4c-f8e057d769c6 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:08 devstack sudo[91590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d5108a4-5ace-404a-aa4c-f8e057d769c6 Apr 16 13:36:08 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:08 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2e09c18e-577c-41a4-b95b-b372740123d5 1073741824" returned: 0 in 0.506s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2e09c18e-577c-41a4-b95b-b372740123d5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:08 devstack sudo[91595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2e09c18e-577c-41a4-b95b-b372740123d5 Apr 16 13:36:08 devstack sudo[91595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:08 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2d5108a4-5ace-404a-aa4c-f8e057d769c6" returned: 0 in 0.521s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-quobyte-2d5108a4-5ace-404a-aa4c-f8e057d769c6" released by "delete_volume" :: held 1.116s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Created reservations ['ed4df986-a365-4d7d-a0ec-bfa3fa28162d', '6006c3b2-8d85-4935-a225-4bc07c2f8084', '24d35115-0276-4d84-baaa-8b5366473f93', 'fc817448-17c7-4aa4-baf6-4c1dca169f89'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:08 devstack sudo[91595]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2e09c18e-577c-41a4-b95b-b372740123d5" returned: 0 in 0.428s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.521s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:08 devstack sudo[91599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:08 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256525931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f51bd2e-1756-43bd-8b3c-3aae35d70f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ab3855781947e1a7eb8917d85d2b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:36:06Z,use_quota=True,user_id='4a42323d4f2849f5b05e9d0e0fac0f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Creating volume 5f51bd2e-1756-43bd-8b3c-3aae35d70f1e {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:36:08 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:36:08 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:09 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8222f4-aef9-498c-88be-48f3525f0bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e09c18e-577c-41a4-b95b-b372740123d5', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:09 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773472ca-5792-4745-a303-cb505aa10be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:09 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume volume-2e09c18e-577c-41a4-b95b-b372740123d5 (2e09c18e-577c-41a4-b95b-b372740123d5): created successfully Apr 16 13:36:09 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e 1073741824 Apr 16 13:36:09 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773472ca-5792-4745-a303-cb505aa10be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:09 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:09 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Flow 'volume_create_manager' (04490e1c-439e-42a8-bcdd-54c8cf8fe4dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:09 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-09c1a356-8657-45b0-9107-b2b771443f99 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Created volume successfully. Apr 16 13:36:09 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.444s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:09 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:09 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Deleted volume successfully. Apr 16 13:36:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-e4a894c3-55fc-49e5-8c76-3e033de2d1a5 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-2d5108a4-5ace-404a-aa4c-f8e057d769c6-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:09 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e 1073741824" returned: 0 in 0.607s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:09 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:09 devstack sudo[91607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e Apr 16 13:36:09 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "cinder-d38f3eac-d436-476c-a740-28ee8622c2de-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-d38f3eac-d436-476c-a740-28ee8622c2de-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "cinder-quobyte-d38f3eac-d436-476c-a740-28ee8622c2de" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:09 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-quobyte-d38f3eac-d436-476c-a740-28ee8622c2de" acquired by "delete_volume" :: waited 0.020s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:10 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d118cb7b-b723-47d5-9720-ee6224146f14]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d38f3eac-d436-476c-a740-28ee8622c2de {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:10 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e" returned: 0 in 0.442s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:36:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.540s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:10 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Cloning volume e7460f83-e1ab-4357-830f-f9e47004ce0c to volume 83e1df37-2cf9-4112-9a31-26071272e774 Apr 16 13:36:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10aa6e52-9d89-43af-8a59-f66719fd10e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40d3378-e43d-4cca-adef-4d1ef01d25c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:10 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume volume-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e (5f51bd2e-1756-43bd-8b3c-3aae35d70f1e): created successfully Apr 16 13:36:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40d3378-e43d-4cca-adef-4d1ef01d25c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:10 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Flow 'volume_create_manager' (5c2afb71-9714-48e1-bd9c-1e0a55c5f8e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:10 devstack sudo[91610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d38f3eac-d436-476c-a740-28ee8622c2de Apr 16 13:36:10 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:10 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-91ae219d-d92c-48f3-902f-cb60417ec420 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Created volume successfully. Apr 16 13:36:10 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Creating offline snapshot 07348d86-ee9f-4b4e-bae6-cfc576d3cde5 of volume e7460f83-e1ab-4357-830f-f9e47004ce0c {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:36:10 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb1eedd-24e7-457c-b11c-28c9ad250cea]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:10 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c Apr 16 13:36:10 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:10 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d38f3eac-d436-476c-a740-28ee8622c2de" returned: 0 in 0.539s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d38f3eac-d436-476c-a740-28ee8622c2de {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:10 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d38f3eac-d436-476c-a740-28ee8622c2de Apr 16 13:36:10 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:10 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c" returned: 0 in 0.653s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:10 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:10 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5 1G Apr 16 13:36:10 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:11 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-d38f3eac-d436-476c-a740-28ee8622c2de" returned: 0 in 0.518s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:11 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-quobyte-d38f3eac-d436-476c-a740-28ee8622c2de" released by "delete_volume" :: held 1.080s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:11 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Created reservations ['a2dee1ad-2b59-4696-861e-7cb58537bef1', 'a3d298e6-2e76-4039-90cb-e1dbf3828657', 'b392b59d-d37f-4c88-b6e3-de0cfc338e2d', '3f4e2091-f6f1-4ff4-a3c5-4a781abc105c'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:11 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:11 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:11 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:11 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:11 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5 1G" returned: 0 in 0.543s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7460f83-e1ab-4357-830f-f9e47004ce0c -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:11 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7460f83-e1ab-4357-830f-f9e47004ce0c -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5 Apr 16 13:36:11 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:11 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.440s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:11 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:11 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Deleted volume successfully. Apr 16 13:36:11 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9f5e624d-7707-4559-bfeb-4e85de2d2255 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-d38f3eac-d436-476c-a740-28ee8622c2de-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:11 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7460f83-e1ab-4357-830f-f9e47004ce0c -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5" returned: 0 in 0.504s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:11 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5 is being set with open permissions: ugo+rw Apr 16 13:36:11 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:11 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5 Apr 16 13:36:11 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:12 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "cinder-aafb33c7-6ffc-4e9a-ab14-10bf489b345a-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:12 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-aafb33c7-6ffc-4e9a-ab14-10bf489b345a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:12 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "cinder-quobyte-aafb33c7-6ffc-4e9a-ab14-10bf489b345a" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:12 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-quobyte-aafb33c7-6ffc-4e9a-ab14-10bf489b345a" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:12 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb92df0b-641e-4578-854d-f5aefccd28ce]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-aafb33c7-6ffc-4e9a-ab14-10bf489b345a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:12 devstack sudo[91638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-aafb33c7-6ffc-4e9a-ab14-10bf489b345a Apr 16 13:36:12 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:12 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5" returned: 0 in 0.477s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:12 devstack sudo[91641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.info Apr 16 13:36:12 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:12 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-aafb33c7-6ffc-4e9a-ab14-10bf489b345a" returned: 0 in 0.511s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-aafb33c7-6ffc-4e9a-ab14-10bf489b345a {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:12 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-aafb33c7-6ffc-4e9a-ab14-10bf489b345a Apr 16 13:36:12 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:12 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.info" returned: 0 in 0.432s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:12 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.info is being set with open permissions: ugo+rw Apr 16 13:36:12 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:12 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.info Apr 16 13:36:12 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:13 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.info" returned: 0 in 0.447s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:13 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "cinder-quobyte-83e1df37-2cf9-4112-9a31-26071272e774" by "_copy_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-aafb33c7-6ffc-4e9a-ab14-10bf489b345a" returned: 0 in 0.537s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-quobyte-aafb33c7-6ffc-4e9a-ab14-10bf489b345a" released by "delete_volume" :: held 1.068s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-83e1df37-2cf9-4112-9a31-26071272e774" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] snapshot: 07348d86-ee9f-4b4e-bae6-cfc576d3cde5, volume: 83e1df37-2cf9-4112-9a31-26071272e774, {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8dbcbc-4b58-415e-911a-1f3c36d0a509]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Created reservations ['2ba7ed8a-1a7c-4262-8017-c30cd8a0b988', 'f6317e6e-0973-4c32-a259-ee014129353f', 'fc6275fb-069d-436d-bc9a-bd046fe30698', 'e53b3a0d-bf8a-42e3-8b77-8dadc8980495'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:13 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5 Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:13 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:13 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:13 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:13 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5" returned: 0 in 0.510s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7460f83-e1ab-4357-830f-f9e47004ce0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Creating direct copy from snapshot {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2eb50a-af97-4d08-b3dc-cd712c32874d]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:13 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.463s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:13 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Deleted volume successfully. Apr 16 13:36:13 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-2f49f56e-edbd-4216-90c0-fb39646be572 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-aafb33c7-6ffc-4e9a-ab14-10bf489b345a-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:13 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c Apr 16 13:36:13 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:14 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "cinder-27503e05-6b8b-4619-b634-0a422d3754ce-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:14 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-27503e05-6b8b-4619-b634-0a422d3754ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:14 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "cinder-quobyte-70363f4f-f18f-4863-b969-9fe13c4496b0" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:14 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-quobyte-70363f4f-f18f-4863-b969-9fe13c4496b0" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:14 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "cinder-quobyte-27503e05-6b8b-4619-b634-0a422d3754ce" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:14 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-quobyte-27503e05-6b8b-4619-b634-0a422d3754ce" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:14 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Deleting offline snapshot 27503e05-6b8b-4619-b634-0a422d3754ce of volume 70363f4f-f18f-4863-b969-9fe13c4496b0 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:36:14 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] snapshot_file for this snap is: volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:36:14 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fee143b-2b3b-4f32-bd52-830eca97cd65]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:14 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c" returned: 0 in 0.573s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:14 devstack cinder-volume[83606]: DEBUG cinder.utils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Path /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-83e1df37-2cf9-4112-9a31-26071272e774 not found in is_blk_device check {{(pid=83606) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 13:36:14 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-83e1df37-2cf9-4112-9a31-26071272e774 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:14 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-83e1df37-2cf9-4112-9a31-26071272e774 Apr 16 13:36:14 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:14 devstack sudo[91669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce Apr 16 13:36:14 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:15 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce" returned: 0 in 0.979s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:15 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70363f4f-f18f-4863-b969-9fe13c4496b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:36:15 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8807f17-f8f2-4726-940b-9fd2f38c1f30]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:15 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:15 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0 Apr 16 13:36:15 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:16 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-83e1df37-2cf9-4112-9a31-26071272e774" returned: 0 in 2.103s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:16 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[da12f74d-0b7b-4aff-a250-f78bb1ef1c09]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:16 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c Apr 16 13:36:16 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:16 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0" returned: 0 in 1.302s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:16 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:16 devstack sudo[91693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce Apr 16 13:36:16 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:17 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce" returned: 0 in 0.500s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:17 devstack sudo[91702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce Apr 16 13:36:17 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:17 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c" returned: 0 in 0.731s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Image conversion details: src /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c, size 1024.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-83e1df37-2cf9-4112-9a31-26071272e774 {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:36:17 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Converted 1024.00 MB image at 486.64 MB/s Apr 16 13:36:17 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-83e1df37-2cf9-4112-9a31-26071272e774 is being set with open permissions: ugo+rw Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-83e1df37-2cf9-4112-9a31-26071272e774 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:17 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-83e1df37-2cf9-4112-9a31-26071272e774 Apr 16 13:36:17 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:17 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0.27503e05-6b8b-4619-b634-0a422d3754ce" returned: 0 in 0.473s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-quobyte-27503e05-6b8b-4619-b634-0a422d3754ce" released by "_delete_snapshot" :: held 3.336s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-quobyte-70363f4f-f18f-4863-b969-9fe13c4496b0" released by "delete_snapshot" :: held 3.350s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:17 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-83e1df37-2cf9-4112-9a31-26071272e774" returned: 0 in 0.485s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-83e1df37-2cf9-4112-9a31-26071272e774" released by "_copy_volume_from_snapshot" :: held 4.457s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "cinder-quobyte-07348d86-ee9f-4b4e-bae6-cfc576d3cde5" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-07348d86-ee9f-4b4e-bae6-cfc576d3cde5" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Deleting offline snapshot 07348d86-ee9f-4b4e-bae6-cfc576d3cde5 of volume e7460f83-e1ab-4357-830f-f9e47004ce0c {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] snapshot_file for this snap is: volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[390dccc3-29bd-41cc-8864-c717ede971f2]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Created reservations ['c2dd5c54-3b6d-4610-96ae-a28d0fddaf72', '45608f35-4693-458f-bfc7-74fa57c67f61', 'eaf66e85-27fa-4ac4-b642-f7624c118849', 'ffd2887e-a2da-4919-b1f9-d2147a878d01'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:17 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Delete snapshot completed successfully. Apr 16 13:36:17 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-b3f1911e-75ff-4355-921b-710f7aa316a0 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-27503e05-6b8b-4619-b634-0a422d3754ce-delete_snapshot" released by "delete_snapshot" :: held 3.489s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:17 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5 Apr 16 13:36:17 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:18 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5" returned: 0 in 0.579s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:18 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7460f83-e1ab-4357-830f-f9e47004ce0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:36:18 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53ee404-2aca-4bce-ac41-87a8552301ce]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:18 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c Apr 16 13:36:18 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:18 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "cinder-70363f4f-f18f-4863-b969-9fe13c4496b0-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:18 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-70363f4f-f18f-4863-b969-9fe13c4496b0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:18 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "cinder-quobyte-70363f4f-f18f-4863-b969-9fe13c4496b0" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:18 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-quobyte-70363f4f-f18f-4863-b969-9fe13c4496b0" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:18 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bda4c1-518f-44a9-9e6f-80a9d1263347]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:18 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0 Apr 16 13:36:18 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:18 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c" returned: 0 in 0.592s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:18 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:18 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5 Apr 16 13:36:18 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:19 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0" returned: 0 in 0.540s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:19 devstack sudo[91725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0 Apr 16 13:36:19 devstack sudo[91725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:19 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5" returned: 0 in 0.468s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:19 devstack sudo[91730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5 Apr 16 13:36:19 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:19 devstack sudo[91725]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-70363f4f-f18f-4863-b969-9fe13c4496b0" returned: 0 in 0.480s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-quobyte-70363f4f-f18f-4863-b969-9fe13c4496b0" released by "delete_volume" :: held 1.057s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Created reservations ['ebf79866-f605-4a6a-ac02-dc49fb7577e7', '04cc3e8e-cabc-45ac-a69b-707614bd3ea3', '151f7f9b-2777-409c-b1ca-64186cd8f246', '5fd7c9a9-dfcf-463a-b072-23c1a3a147fe'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:19 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:19 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:19 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c.07348d86-ee9f-4b4e-bae6-cfc576d3cde5" returned: 0 in 0.436s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-07348d86-ee9f-4b4e-bae6-cfc576d3cde5" released by "_delete_snapshot" :: held 2.129s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.825s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.283s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-409734851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463f5c78-9ea9-4d8a-9af3-dac1de727631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ab3855781947e1a7eb8917d85d2b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:36:06Z,use_quota=True,user_id='4a42323d4f2849f5b05e9d0e0fac0f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Creating volume 463f5c78-9ea9-4d8a-9af3-dac1de727631 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:36:19 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-463f5c78-9ea9-4d8a-9af3-dac1de727631 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:19 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-463f5c78-9ea9-4d8a-9af3-dac1de727631 1073741824 Apr 16 13:36:19 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5764a0-6244-4a4d-9784-e2e59c136d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83e1df37-2cf9-4112-9a31-26071272e774', 'volume_size': 1, 'source_volid': 'e7460f83-e1ab-4357-830f-f9e47004ce0c', 'source_volstatus': 'available'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68959f6-54fb-4565-96f6-e9d0fcbd5f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:19 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Volume volume-83e1df37-2cf9-4112-9a31-26071272e774 (83e1df37-2cf9-4112-9a31-26071272e774): created successfully Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68959f6-54fb-4565-96f6-e9d0fcbd5f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:19 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Flow 'volume_create_manager' (1fe7f8c4-2e6f-45f9-a9f5-6ea6138bdb9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:19 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-a366219e-91fc-4206-b758-5dfc7a85f403 tempest-VolumeDependencyTests-1512928148 None] Created volume successfully. Apr 16 13:36:20 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.430s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:20 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:20 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Deleted volume successfully. Apr 16 13:36:20 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-17ad8199-b017-4150-bf32-e40bc0024603 tempest-CreateVolumesFromSnapshotTest-1747326201 None] Lock "cinder-70363f4f-f18f-4863-b969-9fe13c4496b0-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:20 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-463f5c78-9ea9-4d8a-9af3-dac1de727631 1073741824" returned: 0 in 0.571s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-463f5c78-9ea9-4d8a-9af3-dac1de727631 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:20 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-463f5c78-9ea9-4d8a-9af3-dac1de727631 Apr 16 13:36:20 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:20 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-463f5c78-9ea9-4d8a-9af3-dac1de727631" returned: 0 in 0.419s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:20 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:36:20 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebeec07-d6a6-40ad-98d5-2cda582c5d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463f5c78-9ea9-4d8a-9af3-dac1de727631', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497c34d9-6f4b-4b16-9f25-190e05e0909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:20 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Volume volume-463f5c78-9ea9-4d8a-9af3-dac1de727631 (463f5c78-9ea9-4d8a-9af3-dac1de727631): created successfully Apr 16 13:36:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497c34d9-6f4b-4b16-9f25-190e05e0909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:20 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Flow 'volume_create_manager' (de25c0a6-e2b9-4ba1-8c53-9aec241846e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:21 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-ff4650e7-27bb-472e-9a67-da03c4b31063 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Created volume successfully. Apr 16 13:36:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "cinder-e7460f83-e1ab-4357-830f-f9e47004ce0c-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-e7460f83-e1ab-4357-830f-f9e47004ce0c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "cinder-quobyte-e7460f83-e1ab-4357-830f-f9e47004ce0c" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-e7460f83-e1ab-4357-830f-f9e47004ce0c" acquired by "delete_volume" :: waited 0.013s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:21 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c41873-3995-4246-833a-bae1828f8bed]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:21 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c Apr 16 13:36:21 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:21 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c" returned: 0 in 0.595s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:21 devstack sudo[91750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c Apr 16 13:36:21 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "cinder-463f5c78-9ea9-4d8a-9af3-dac1de727631-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-463f5c78-9ea9-4d8a-9af3-dac1de727631-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "cinder-quobyte-463f5c78-9ea9-4d8a-9af3-dac1de727631" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:21 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-quobyte-463f5c78-9ea9-4d8a-9af3-dac1de727631" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:21 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b3aa58-587b-4372-93d8-f44107d2d9e6]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:21 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-463f5c78-9ea9-4d8a-9af3-dac1de727631 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:21 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-463f5c78-9ea9-4d8a-9af3-dac1de727631 Apr 16 13:36:21 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:22 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-e7460f83-e1ab-4357-830f-f9e47004ce0c" returned: 0 in 0.523s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-e7460f83-e1ab-4357-830f-f9e47004ce0c" released by "delete_volume" :: held 1.161s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] Created reservations ['a914b5bd-75a2-46f9-a27d-635254f0e4f5', 'f1e284a7-ee15-4029-aa61-b733c5a42d66', 'fff04fa8-fc56-41b8-854e-e80fb04cebf2', '083d8950-313a-4b18-82ef-d7aa155dc42a'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:22 devstack sudo[91755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:22 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Flow 'volume_create_manager' (c91bb480-0e01-4eb2-9305-ef098f0867c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d74201-4718-4ee9-b787-2474441c5b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d74201-4718-4ee9-b787-2474441c5b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-134441277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52eb2675-161a-4e2b-b674-a4dfe8e36ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0a7d8af69e04ee6a20fe34c30888921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:36:22Z,use_quota=True,user_id='52e2ccaa45344af2a0cd81ea615842f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:22 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784b5d74-fda3-43cb-8305-878d0f216134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784b5d74-fda3-43cb-8305-878d0f216134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126fcf74-5d78-4328-a434-15535bf66ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126fcf74-5d78-4328-a434-15535bf66ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52eb2675-161a-4e2b-b674-a4dfe8e36ad1', 'volume_name': 'volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac9dae6-c437-434e-87bc-54c175a2c3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac9dae6-c437-434e-87bc-54c175a2c3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed219300-62ca-4717-9017-0f4bcce9b71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:22 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Volume 52eb2675-161a-4e2b-b674-a4dfe8e36ad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1', 'volume_size': 1} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-134441277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52eb2675-161a-4e2b-b674-a4dfe8e36ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0a7d8af69e04ee6a20fe34c30888921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:36:22Z,use_quota=True,user_id='52e2ccaa45344af2a0cd81ea615842f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)}" {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Creating volume 52eb2675-161a-4e2b-b674-a4dfe8e36ad1 {{(pid=83606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:36:22 devstack cinder-volume[83606]: INFO cinder.volume.drivers.remotefs [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] casted to osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 1073741824 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-463f5c78-9ea9-4d8a-9af3-dac1de727631" returned: 0 in 0.678s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-463f5c78-9ea9-4d8a-9af3-dac1de727631 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:22 devstack sudo[91760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 1073741824 Apr 16 13:36:22 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:22 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-463f5c78-9ea9-4d8a-9af3-dac1de727631 Apr 16 13:36:22 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:22 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.434s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:22 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] Deleted volume successfully. Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1203cfc9-ab54-4f84-b6f2-148b9c0c5f5d tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-e7460f83-e1ab-4357-830f-f9e47004ce0c-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:22 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-463f5c78-9ea9-4d8a-9af3-dac1de727631" returned: 0 in 0.427s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-quobyte-463f5c78-9ea9-4d8a-9af3-dac1de727631" released by "delete_volume" :: held 1.139s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:22 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Created reservations ['8b44067b-6128-44f9-98b3-c8339af0e50f', 'c3eb0427-961b-4559-bfe9-b2c65281b89a', 'fb43de76-16ab-4b4a-b1fa-4c86f90a26b0', '0f8c4fa9-6e19-4cda-a160-920133e5f38e'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:23 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 1073741824" returned: 0 in 0.509s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:23 devstack sudo[91769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:23 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:23 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 Apr 16 13:36:23 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "cinder-83e1df37-2cf9-4112-9a31-26071272e774-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-83e1df37-2cf9-4112-9a31-26071272e774-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "cinder-quobyte-83e1df37-2cf9-4112-9a31-26071272e774" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-83e1df37-2cf9-4112-9a31-26071272e774" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b99da4-e1d0-4557-99d9-1f875e2f27b5]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-83e1df37-2cf9-4112-9a31-26071272e774 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:23 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-83e1df37-2cf9-4112-9a31-26071272e774 Apr 16 13:36:23 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:23 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.412s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:23 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Deleted volume successfully. Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-dc1a5777-d2ef-4b49-87bb-e76124ab756a tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-463f5c78-9ea9-4d8a-9af3-dac1de727631-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:23 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1" returned: 0 in 0.456s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'} {{(pid=83606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed219300-62ca-4717-9017-0f4bcce9b71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1', 'volume_size': 1}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0b41a4-9f32-48c2-8352-05908dd0f5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:23 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Volume volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 (52eb2675-161a-4e2b-b674-a4dfe8e36ad1): created successfully Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0b41a4-9f32-48c2-8352-05908dd0f5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Flow 'volume_create_manager' (c91bb480-0e01-4eb2-9305-ef098f0867c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:23 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-b5b1c07e-a162-46e7-a706-a043d708523a tempest-SnapshotDependencyTests-668881607 None] Created volume successfully. Apr 16 13:36:23 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-83e1df37-2cf9-4112-9a31-26071272e774" returned: 0 in 0.492s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:23 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-83e1df37-2cf9-4112-9a31-26071272e774 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:23 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-83e1df37-2cf9-4112-9a31-26071272e774 Apr 16 13:36:23 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "cinder-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "cinder-quobyte-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-quobyte-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a1030f-a9f8-469b-8f8c-b6c7529405c7]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:24 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e Apr 16 13:36:24 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:24 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-83e1df37-2cf9-4112-9a31-26071272e774" returned: 0 in 0.418s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-83e1df37-2cf9-4112-9a31-26071272e774" released by "delete_volume" :: held 0.934s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] Created reservations ['2cc0ef6e-9e5b-4fb5-a6ee-a9689a459425', '26386fc0-3e97-4aec-ac43-c9a4caaaf858', '19078c3e-6462-4043-8695-250ff7882192', '5efbb90f-5ef2-47a3-b5fd-936b43066d27'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:24 devstack sudo[91786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:24 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "cinder-9fef1fc7-d104-4d20-a210-c344156d76d2-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-9fef1fc7-d104-4d20-a210-c344156d76d2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "cinder-quobyte-9fef1fc7-d104-4d20-a210-c344156d76d2" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-9fef1fc7-d104-4d20-a210-c344156d76d2" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[213826e6-fe8c-4827-80d3-261da0e64ecf]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9fef1fc7-d104-4d20-a210-c344156d76d2 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:24 devstack sudo[91788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9fef1fc7-d104-4d20-a210-c344156d76d2 Apr 16 13:36:24 devstack sudo[91788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:24 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e" returned: 0 in 0.543s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:24 devstack sudo[91793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e Apr 16 13:36:24 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:24 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.479s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:24 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] Deleted volume successfully. Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] Creating offline snapshot bbdebb61-c37c-4d6b-9736-3c2b40635a99 of volume 52eb2675-161a-4e2b-b674-a4dfe8e36ad1 {{(pid=83606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbacea23-f488-43b6-8bef-3a2ede1640d1]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-9f80c9c4-57b9-4d46-a92f-41aa7b78eba1 tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-83e1df37-2cf9-4112-9a31-26071272e774-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:24 devstack sudo[91796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 Apr 16 13:36:24 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:24 devstack sudo[91788]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9fef1fc7-d104-4d20-a210-c344156d76d2" returned: 0 in 0.526s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:24 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9fef1fc7-d104-4d20-a210-c344156d76d2 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:25 devstack sudo[91801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9fef1fc7-d104-4d20-a210-c344156d76d2 Apr 16 13:36:25 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:25 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e" returned: 0 in 0.459s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-quobyte-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e" released by "delete_volume" :: held 1.021s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Created reservations ['2a8138c6-fb66-437f-b4c3-7749c518b726', '2e6e39d0-c56e-45de-a46a-bc0aa0efa207', '04a65f3f-7d5c-468e-a2d8-929fd3653b50', '9ab08821-7c28-4e4b-937c-8382820f06dc'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:25 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:25 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:25 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1" returned: 0 in 0.495s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99 1G {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:25 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99 1G Apr 16 13:36:25 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:25 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-9fef1fc7-d104-4d20-a210-c344156d76d2" returned: 0 in 0.445s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-quobyte-9fef1fc7-d104-4d20-a210-c344156d76d2" released by "delete_volume" :: held 0.996s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] Created reservations ['072b5935-bc99-4356-9883-df377031307f', '082a6f58-e773-424f-a1e8-835ee84164b0', '3dbcf82b-36a0-4db1-b80f-b7d73420cd0c', 'eea6b160-20cb-4e5c-8a16-61c7b11680b7'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:25 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:25 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:25 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.450s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:25 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Deleted volume successfully. Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-7d4a66b1-edb9-4564-ba09-48d519c3f520 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-5f51bd2e-1756-43bd-8b3c-3aae35d70f1e-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:25 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99 1G" returned: 0 in 0.489s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:25 devstack sudo[91818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99 Apr 16 13:36:25 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:25 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.415s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:25 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] Deleted volume successfully. Apr 16 13:36:25 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-5dcb8d1e-dc56-4df8-884b-7e714df81dcd tempest-VolumeDependencyTests-1512928148 None] Lock "cinder-9fef1fc7-d104-4d20-a210-c344156d76d2-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "cinder-2e09c18e-577c-41a4-b95b-b372740123d5-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-2e09c18e-577c-41a4-b95b-b372740123d5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:26 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 -F qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99" returned: 0 in 0.446s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:26 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99 is being set with open permissions: ugo+rw Apr 16 13:36:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "cinder-quobyte-2e09c18e-577c-41a4-b95b-b372740123d5" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:26 devstack sudo[91824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99 Apr 16 13:36:26 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-quobyte-2e09c18e-577c-41a4-b95b-b372740123d5" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:26 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:26 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45521d3-10d9-4bec-b965-848380fff884]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2e09c18e-577c-41a4-b95b-b372740123d5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:26 devstack sudo[91826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2e09c18e-577c-41a4-b95b-b372740123d5 Apr 16 13:36:26 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:26 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99" returned: 0 in 0.452s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:26 devstack sudo[91832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.info Apr 16 13:36:26 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:26 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2e09c18e-577c-41a4-b95b-b372740123d5" returned: 0 in 0.476s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:26 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2e09c18e-577c-41a4-b95b-b372740123d5 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:26 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2e09c18e-577c-41a4-b95b-b372740123d5 Apr 16 13:36:26 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:27 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-2e09c18e-577c-41a4-b95b-b372740123d5" returned: 0 in 0.438s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-quobyte-2e09c18e-577c-41a4-b95b-b372740123d5" released by "delete_volume" :: held 0.934s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:27 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.info" returned: 0 in 0.506s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:27 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.info is being set with open permissions: ugo+rw Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.info {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:27 devstack sudo[91838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.info Apr 16 13:36:27 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Created reservations ['dee310e6-77a4-42c1-98de-f3b248f663fd', '680bd4d1-790e-433f-bd00-93b41b53b0cd', '58f7569a-ac6e-436c-ac28-2ab248c86ce6', '43f80bbb-33f7-4b67-b92a-7093076946f5'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "cinder-30f94ce1-bd33-4958-be32-79be4ad35032-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-30f94ce1-bd33-4958-be32-79be4ad35032-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:27 devstack sudo[91840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:27 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "cinder-quobyte-30f94ce1-bd33-4958-be32-79be4ad35032" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-quobyte-30f94ce1-bd33-4958-be32-79be4ad35032" acquired by "delete_volume" :: waited 0.011s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4355a9-fab2-4591-9820-4121ec566155]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-30f94ce1-bd33-4958-be32-79be4ad35032 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:27 devstack sudo[91842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-30f94ce1-bd33-4958-be32-79be4ad35032 Apr 16 13:36:27 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:27 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.info" returned: 0 in 0.496s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.949s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:27 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-b4c0ebc7-48fc-4408-8bf3-1cd1bfc587eb tempest-SnapshotDependencyTests-668881607 None] Create snapshot completed successfully Apr 16 13:36:27 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.513s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:27 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Deleted volume successfully. Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-914c1061-f6a4-4326-ac8f-315e21467495 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-2e09c18e-577c-41a4-b95b-b372740123d5-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:27 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-30f94ce1-bd33-4958-be32-79be4ad35032" returned: 0 in 0.567s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:27 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-30f94ce1-bd33-4958-be32-79be4ad35032 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:28 devstack sudo[91849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-30f94ce1-bd33-4958-be32-79be4ad35032 Apr 16 13:36:28 devstack sudo[91849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Flow 'volume_create_manager' (eb5d0f65-6fa3-4d1c-b654-0194bab36e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e63082e-a935-4544-8b99-5b1087e59dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e63082e-a935-4544-8b99-5b1087e59dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T11:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb0fcac-6652-4b02-b288-4b9a66fdb9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0a7d8af69e04ee6a20fe34c30888921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T11:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bbdebb61-c37c-4d6b-9736-3c2b40635a99,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T11:36:28Z,use_quota=True,user_id='52e2ccaa45344af2a0cd81ea615842f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b),volume_type_id=41b39c01-0cb7-4d4d-ab2d-0d96ec5d143b)' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a09940-aa89-4fbe-a848-41acd2d5ee4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a09940-aa89-4fbe-a848-41acd2d5ee4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd9dc00-77aa-42fc-bbaa-13773b0d73cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd9dc00-77aa-42fc-bbaa-13773b0d73cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cfb0fcac-6652-4b02-b288-4b9a66fdb9d3', 'volume_name': 'volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3', 'volume_size': 1, 'snapshot_id': 'bbdebb61-c37c-4d6b-9736-3c2b40635a99'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a67a562-81ad-4d05-9a6f-e58f44c6a2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a67a562-81ad-4d05-9a6f-e58f44c6a2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfdb4b8-536d-4096-8d93-26e1feb8af0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:28 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Volume cfb0fcac-6652-4b02-b288-4b9a66fdb9d3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3', 'volume_size': 1, 'snapshot_id': 'bbdebb61-c37c-4d6b-9736-3c2b40635a99'} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Acquiring lock "cinder-quobyte-bbdebb61-c37c-4d6b-9736-3c2b40635a99-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3" by "_create_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-quobyte-bbdebb61-c37c-4d6b-9736-3c2b40635a99-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Creating volume cfb0fcac-6652-4b02-b288-4b9a66fdb9d3 from snapshot bbdebb61-c37c-4d6b-9736-3c2b40635a99 {{(pid=83606) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Selected osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912 as target Quobyte volume. {{(pid=83606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Acquiring lock "cinder-quobyte-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3" by "_copy_volume_from_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-quobyte-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] snapshot: bbdebb61-c37c-4d6b-9736-3c2b40635a99, volume: cfb0fcac-6652-4b02-b288-4b9a66fdb9d3, {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a534de66-59bf-4c93-83f0-612b248211d0]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:28 devstack sudo[91851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99 Apr 16 13:36:28 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:28 devstack sudo[91849]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-30f94ce1-bd33-4958-be32-79be4ad35032" returned: 0 in 0.435s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-quobyte-30f94ce1-bd33-4958-be32-79be4ad35032" released by "delete_volume" :: held 1.028s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Created reservations ['d812a1fb-ec48-422b-8700-915edd7f9eb2', '3e53c294-fafd-42af-af1e-0c1a8e654648', 'd29d27ed-d333-4b90-a2a8-a0f7f5cd3627', 'b5b71556-4098-4055-81ec-4af29c71d604'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:28 devstack sudo[91854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:28 devstack sudo[91854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:28 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99" returned: 0 in 0.474s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Creating direct copy from snapshot {{(pid=83606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[19214b27-798d-4b04-af37-adeaf3bef93d]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:28 devstack sudo[91859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 Apr 16 13:36:28 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:28 devstack sudo[91854]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.404s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:28 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Deleted volume successfully. Apr 16 13:36:28 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1e38af28-f756-4eff-97a3-1650ddc94086 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-30f94ce1-bd33-4958-be32-79be4ad35032-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:29 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1" returned: 0 in 0.465s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:29 devstack cinder-volume[83606]: DEBUG cinder.utils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Path /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3 not found in is_blk_device check {{(pid=83606) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 13:36:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:29 devstack sudo[91865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3 Apr 16 13:36:29 devstack sudo[91865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "cinder-6c3e9af6-371c-48d4-8e77-f6a581f59c5e-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-6c3e9af6-371c-48d4-8e77-f6a581f59c5e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "cinder-quobyte-6c3e9af6-371c-48d4-8e77-f6a581f59c5e" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:29 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-quobyte-6c3e9af6-371c-48d4-8e77-f6a581f59c5e" acquired by "delete_volume" :: waited 0.008s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:29 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[124d0314-b2b3-49f5-ac46-16b94d60e96f]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:29 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6c3e9af6-371c-48d4-8e77-f6a581f59c5e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:29 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6c3e9af6-371c-48d4-8e77-f6a581f59c5e Apr 16 13:36:29 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:30 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6c3e9af6-371c-48d4-8e77-f6a581f59c5e" returned: 0 in 1.230s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:30 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6c3e9af6-371c-48d4-8e77-f6a581f59c5e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:30 devstack sudo[91882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6c3e9af6-371c-48d4-8e77-f6a581f59c5e Apr 16 13:36:30 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:31 devstack sudo[91865]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3" returned: 0 in 1.861s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aab2a5-e77e-4daa-af3a-7116c72a8d0b]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:31 devstack sudo[91884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 Apr 16 13:36:31 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:31 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-6c3e9af6-371c-48d4-8e77-f6a581f59c5e" returned: 0 in 0.589s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-quobyte-6c3e9af6-371c-48d4-8e77-f6a581f59c5e" released by "delete_volume" :: held 1.852s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Created reservations ['9f6c4bad-df83-462d-ab94-9d989811773c', '3f213142-6132-4c40-bb6c-37a820bac624', 'db1b8dbd-6e22-434c-a3ef-a27f9b83f31c', 'f29c4976-a826-418f-a5f3-6eb6c3d8566d'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:31 devstack sudo[91887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:31 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:31 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1" returned: 0 in 0.610s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG cinder.image.image_utils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Image conversion details: src /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1, size 1024.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3 {{(pid=83606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 13:36:31 devstack cinder-volume[83606]: INFO cinder.image.image_utils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Converted 1024.00 MB image at 549.79 MB/s Apr 16 13:36:31 devstack cinder-volume[83606]: WARNING cinder.volume.drivers.remotefs [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3 is being set with open permissions: ugo+rw Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:31 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3 Apr 16 13:36:31 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "cinder-b9d9c9fe-17c9-4256-b5a0-c04de23536f3-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-b9d9c9fe-17c9-4256-b5a0-c04de23536f3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "cinder-quobyte-b9d9c9fe-17c9-4256-b5a0-c04de23536f3" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-quobyte-b9d9c9fe-17c9-4256-b5a0-c04de23536f3" acquired by "delete_volume" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[70794072-5214-4556-b9fa-392021e542d5]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b9d9c9fe-17c9-4256-b5a0-c04de23536f3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:31 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.412s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:31 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Deleted volume successfully. Apr 16 13:36:31 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b9d9c9fe-17c9-4256-b5a0-c04de23536f3 Apr 16 13:36:31 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:31 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-347178b5-ac26-4d25-83f7-1d8bb96fb557 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-6c3e9af6-371c-48d4-8e77-f6a581f59c5e-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:32 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3" returned: 0 in 0.430s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-quobyte-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3" released by "_copy_volume_from_snapshot" :: held 3.897s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-quobyte-bbdebb61-c37c-4d6b-9736-3c2b40635a99-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3" released by "_create_volume_from_snapshot" :: held 3.915s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.924s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfdb4b8-536d-4096-8d93-26e1feb8af0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3', 'volume_size': 1, 'snapshot_id': 'bbdebb61-c37c-4d6b-9736-3c2b40635a99'}' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0815282-14c9-4450-a38d-99239ba5f5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 13:36:32 devstack cinder-volume[83606]: INFO cinder.volume.flows.manager.create_volume [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Volume volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3 (cfb0fcac-6652-4b02-b288-4b9a66fdb9d3): created successfully Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0815282-14c9-4450-a38d-99239ba5f5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83606) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.volume.manager [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Flow 'volume_create_manager' (eb5d0f65-6fa3-4d1c-b654-0194bab36e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83606) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 13:36:32 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-1ac9a1d1-b8ed-457a-8b4f-b1a55ca5d9cc tempest-SnapshotDependencyTests-668881607 None] Created volume successfully. Apr 16 13:36:32 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b9d9c9fe-17c9-4256-b5a0-c04de23536f3" returned: 0 in 0.461s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b9d9c9fe-17c9-4256-b5a0-c04de23536f3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:32 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b9d9c9fe-17c9-4256-b5a0-c04de23536f3 Apr 16 13:36:32 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] Acquiring lock "cinder-bbdebb61-c37c-4d6b-9736-3c2b40635a99-delete_snapshot" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-bbdebb61-c37c-4d6b-9736-3c2b40635a99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] Acquiring lock "cinder-quobyte-52eb2675-161a-4e2b-b674-a4dfe8e36ad1" by "delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-quobyte-52eb2675-161a-4e2b-b674-a4dfe8e36ad1" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] Acquiring lock "cinder-quobyte-bbdebb61-c37c-4d6b-9736-3c2b40635a99" by "_delete_snapshot" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-quobyte-bbdebb61-c37c-4d6b-9736-3c2b40635a99" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] Deleting offline snapshot bbdebb61-c37c-4d6b-9736-3c2b40635a99 of volume 52eb2675-161a-4e2b-b674-a4dfe8e36ad1 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] snapshot_file for this snap is: volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99 {{(pid=83606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[09700d56-b89a-4042-837e-685246dd7a5c]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:32 devstack sudo[91903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99 Apr 16 13:36:32 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:32 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-b9d9c9fe-17c9-4256-b5a0-c04de23536f3" returned: 0 in 0.415s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-quobyte-b9d9c9fe-17c9-4256-b5a0-c04de23536f3" released by "delete_volume" :: held 0.900s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Created reservations ['aedb2ee8-0500-4d44-90ed-6cbd15a45961', 'c1622937-207d-4b92-85d7-a5034a65713d', 'cbe121e4-5621-49c6-b445-fe8c23f4c01e', 'f8d2f427-7eaf-4bbf-91f6-57dd2f1739ab'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:32 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:32 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:32 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:33 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99" returned: 0 in 0.486s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:33 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.remotefs [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 13:36:33 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[5973cc48-d45e-4540-b1b7-791e603a32d0]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:33 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 Apr 16 13:36:33 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:33 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.493s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:33 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:33 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Deleted volume successfully. Apr 16 13:36:33 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-c64e8e0a-8eff-46ec-8ad3-1091ef4b7f61 tempest-CreateVolumesFromSourceVolumeTest-2022352898 None] Lock "cinder-b9d9c9fe-17c9-4256-b5a0-c04de23536f3-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:33 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1" returned: 0 in 0.533s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:33 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:33 devstack sudo[91917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99 Apr 16 13:36:33 devstack sudo[91917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:34 devstack sudo[91917]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99" returned: 0 in 0.475s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:34 devstack sudo[91923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99 Apr 16 13:36:34 devstack sudo[91923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:34 devstack sudo[91923]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1.bbdebb61-c37c-4d6b-9736-3c2b40635a99" returned: 0 in 0.390s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-quobyte-bbdebb61-c37c-4d6b-9736-3c2b40635a99" released by "_delete_snapshot" :: held 1.937s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-quobyte-52eb2675-161a-4e2b-b674-a4dfe8e36ad1" released by "delete_snapshot" :: held 1.950s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] Created reservations ['5a02f9a2-245c-4258-97e2-5c59c27796f3', '00ee06e6-c475-4e7e-bf8f-63ea8c7c3819', '8e43648e-e0d6-4e6b-80d2-e04cf61b05bc', 'd452637b-00a0-4662-8827-39039bdb9b31'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG oslo_service.periodic_task [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83606) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:34 devstack sudo[91926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:34 devstack sudo[91926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:34 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] Delete snapshot completed successfully. Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-8d66e564-f857-4d71-a0f2-8170d351fa7c tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-bbdebb61-c37c-4d6b-9736-3c2b40635a99-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] Acquiring lock "cinder-52eb2675-161a-4e2b-b674-a4dfe8e36ad1-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-52eb2675-161a-4e2b-b674-a4dfe8e36ad1-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] Acquiring lock "cinder-quobyte-52eb2675-161a-4e2b-b674-a4dfe8e36ad1" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-quobyte-52eb2675-161a-4e2b-b674-a4dfe8e36ad1" acquired by "delete_volume" :: waited 0.016s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[59704c1f-2251-4a08-979a-f15824c57225]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:34 devstack sudo[91929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 Apr 16 13:36:34 devstack sudo[91929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:34 devstack sudo[91926]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.470s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:34 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-6e84d180-f643-491d-abbc-edef0c8bd871 None None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:35 devstack sudo[91929]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1" returned: 0 in 0.456s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:35 devstack sudo[91935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1 Apr 16 13:36:35 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:35 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-52eb2675-161a-4e2b-b674-a4dfe8e36ad1" returned: 0 in 0.408s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:35 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-quobyte-52eb2675-161a-4e2b-b674-a4dfe8e36ad1" released by "delete_volume" :: held 0.892s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:35 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] Created reservations ['dfa2ca20-e391-4a19-8592-4f7cabcc060f', '386e6335-564e-4f47-a151-7527b662690b', '4d285b5a-113a-4cfc-bc71-08aff454781f', '7a7975aa-e1ae-407c-86bc-57a012f05f2c'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:35 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:35 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:35 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:35 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] Acquiring lock "cinder-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3-delete_volume" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:35 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:35 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] Acquiring lock "cinder-quobyte-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3" by "delete_volume" {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 13:36:35 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-quobyte-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3" acquired by "delete_volume" :: waited 0.006s {{(pid=83606) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 13:36:35 devstack cinder-volume[83606]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce4b5f0-802d-498d-9ecf-3773a0f2d0d4]: (4, 'qcow2') {{(pid=84391) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 13:36:35 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:35 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3 Apr 16 13:36:35 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:36 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.441s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:36 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:36 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] Deleted volume successfully. Apr 16 13:36:36 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-d70c88b0-a468-42ec-a245-1f46ace3c83c tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-52eb2675-161a-4e2b-b674-a4dfe8e36ad1-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:36 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3" returned: 0 in 0.491s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3 {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:36 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3 Apr 16 13:36:36 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:36 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e/volume-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3" returned: 0 in 0.387s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:36 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-quobyte-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3" released by "delete_volume" :: held 0.909s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:36 devstack cinder-volume[83606]: DEBUG cinder.quota [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] Created reservations ['ee9d2d1f-e5e5-4c2e-98ac-4534b1661ac8', '97e07bff-136b-40c5-bc4e-867696288878', '9af956f2-7551-46b5-b67f-a94520f7a738', '8a6007bf-8c32-418a-9fd9-66c81cea6214'] {{(pid=83606) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 13:36:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 13:36:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 13:36:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912': None} {{(pid=83606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 13:36:36 devstack cinder-volume[83606]: DEBUG cinder.volume.drivers.quobyte [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c02f8dd9-9041-4c43-ac56-a01995982912'] {{(pid=83606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 13:36:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.lockutils [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83606) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 13:36:36 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 13:36:36 devstack sudo[91949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e Apr 16 13:36:36 devstack sudo[91949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 13:36:37 devstack sudo[91949]: pam_unix(sudo:session): session closed for user root Apr 16 13:36:37 devstack cinder-volume[83606]: DEBUG oslo_concurrency.processutils [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4298d7eaf83952f6156b382a6973492e" returned: 0 in 0.429s {{(pid=83606) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 13:36:37 devstack cinder-volume[83606]: DEBUG cinder.manager [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] Notifying Schedulers of capabilities ... {{(pid=83606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 13:36:37 devstack cinder-volume[83606]: INFO cinder.volume.manager [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] Deleted volume successfully. Apr 16 13:36:37 devstack cinder-volume[83606]: DEBUG cinder.coordination [None req-bff254b3-fe30-440d-aa7a-71ea1c69792c tempest-SnapshotDependencyTests-668881607 None] Lock "cinder-cfb0fcac-6652-4b02-b288-4b9a66fdb9d3-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=83606) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 13:36:46 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:UPDATE=184,cinder:DELETE=12,cinder:SELECT=116,cinder:INSERT=46 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 13:36:47 devstack cinder-volume[83606]: DEBUG dbcounter [-] [83606] Writing DB stats cinder:UPDATE=147,cinder:SELECT=111,cinder:INSERT=36,cinder:DELETE=14 {{(pid=83606) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}